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To Whom lit May Concern: 

BE IT KNOWN THAT We, Tsuyoshi HANAMURA, a citizen of Japan, residing at c/o 
Media Glue Corporation, 4-12, Okubo 2-chome, Shinjuku-ku, Tokyo, Japan, Isao NAGAYOSHI, 
a citizen of Japan, residing at c/o Global Information and Telecommunication Institute, Waseda 
University, 3-10, Nishi-Waseda 1-chome, Shinjuku-ku, Tokyo, Japan, Hiroyuki KASAI, a 
citizen of Japan, residing at c/o Global Ihfonnation and Telecommunication Institute, Waseda 
University, 3-10, Nishi-Waseda 1-chome, Shinjuku-ku, Tokyo, Japan, and Hideyoshi 
TOMINAGA, a citizen of Japan, residing at c/o Global Information and Telecommunication 
Institute, Waseda University, 3-10, Nishi-Waseda 1-chome, Shinjuku-ku, Tokyo, Japan, have 
made a new and useful improvement in "Bit Stream Separating and Merging System, Apparatus, 
Method and Computer Program Product" of which the following is the true and exact 
specification, reference being had to the accompanying drawings. 
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BIT STREAM SEPARATING AND MERGING SYSTEM, APPARATUS, 
METHOD AND COMPUTER PROGRAM PRODUCT 



BACKGROUND OF THE INVENTION 

1 . Field of the Invention 

The present invention relates to apparatuses, methods and computer program 
products for separating and merging a coded moving picture sequence signal, and more 
particularly, to apparatuses, methods and computer program products for transcoding a 
first coded moving picture sequence signal to separate into and generate a second coded 
moving picture sequence signal and a differential coded moving picture sequence signal, 
which is a difference between the first coded moving picture sequence signal and the 
second coded moving picture sequence signal, and merging the second coded moving 
picture sequence signal and the differential coded moving picture sequence signal to 
reconstruct the first coded moving picture sequence signal. 

2. Description of the Related Art 

There have so far been proposed a wide variety of systems for compressing and 
encoding a moving picture having a considerable amount of data to produce a coded 
moving picture sequence signal. The international standard, ISO-IEC 13818, was 
created for a system operable to encode a digital video signal with an associated digital 
audio signal and commonly called "Moving Picture Expert Group Phase 2", i.e., 
"MPEG-2". In such an encoding system, the coded moving picture sequence signal is 
outputted in the form of bit streams. In particular, the bit streams conformable to the 
above MPEG-2 standard will be referred to as "MPEG-2 bit streams" hereinlater. 
Recently, the system of this type becomes more utilizable for various technical fields, 
such as a communications system, a television broadcasting service system, and so on. 

The above MPEG-2 bit stream have a hierarchical structure consisting of: in 
rum, a top, sequence layer; a GROUP OF PICTURES layer; a picture layer; a slice 
layer; a macroblock layer; and a low, block layer. 

The typical encoder operates under the MPEG-2 standard through a method of 
compressing and encoding a moving picture as follows. The method comprises the 
steps of: 

(a) inputting the moving picture sequence consisting of a series of pictures; 

(b) temporarily storing the series of pictures as frames in memories, respectively; 

(c) computing a difference between one frame and another frame to eliminate 
redundancy in a time axis direction; and 

(d) orthogonal transforming, e.g., discrete cosine transforming (DCT), a plurality 
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of picture elements within each of the frames to eliminate redundancy in a spatial axis 
direction. 

The encoder thus constructed can compress and encode the moving picture to 
generate and output a coded moving picture sequence signal in the form of the MPEG-2 
bit stream through a transmitting path at a predetemiined bit rate. The coded moving 
picture sequence signal is then transmitted from the encoder to a decoder which is 
operated to decode the coded signal to reproduce the moving picture. The typical 
decoder is operated to decode the coded moving picture sequence signal through a 
so-called bi-directionally predicting method which comprises the steps of: 

(a) storing one reproduced picture, generally referred to as "intra-picture", i.e., 
"I-picture", in a first frame memory; 

(b) estimating another picture generally referred to as "predictive-picture", i.e., 
"P-picture", followed by the I-picture, on the basis of the information on the difference 
between the I-picture and P-picture; 

(c) storing the estimated P-picture in a second frame memory; and 

(d) estimating further another picture interposed between the I-picture and 
P-picture, generally referred to as "bi-directionally predictive-picture", i.e., "B-picture". 

Here, the I-picture is encoded independently of the pictures of the other types, 
so that an I-picture can be reproduced as a single static image only by itself. A 
P-picture can be predicted on the basis of the I-picture or another P-picture located on a 
position prior to the P-picture to be encoded. I-picture is referred to as "intra-picture" 
while P-picture and B-picture are referred to as "inter-pictures". 

In the above encoder, the amount of information on the coded moving picture 
sequence signal is, however, variable. In particular, the amount of information 
increases remarkably when a scene is changed. The decoder is generally provided 
with an input buffer for receiving the coded moving picture sequence signal from the 
encoder. The input buffer of the decoder, however, has a limited storage capacity. 
Therefore, when a large number of bits of the coded moving picture sequence signal are 
transmitted from the encoder to the decoder, the input buffer overflows with the bits of 
the coded moving picture sequence signal thereby making the decoder difficult to 
process the coded moving picture sequence signal, hi order to transmit such coded 
moving picture sequence signal having a variable number of bits through the 
transmitting path at a predetermined bit rate and to make it possible for any decoder to 
receive the whole of the coded moving picture sequence signal without overflow, the 
encoder comprises: an output buffer for temporarily storing the coded moving picture 
sequence signal before transmitting the coded moving picture sequence signal through 



the transmitting path; and a rate controller for controlling the amount of bits of the 
coded moving picture sequence signal stored in the output buffer so as to keep the 
amount of bits of the coded moving picture sequence signal to be transmitted to the 
decoder for a predetermined time from exceeding the capacity of the input buffer of the 
decoder, thereby controlling the bit rate of the coded moving picture sequence signal. 

A typical rate controlling method in MPEG-2 standard is described in 
"ISO-IEC/JTC1/SC29AVG11/N0400 Test Model 5", April, 1993, hereinlater referred to 
as "TM-5". The rate controlling method according to the TM-5 comprises the steps of: 
(I) allocating a target number of bits to a picture of each type on the basis of the 
total number of bits, i.e., R, available to the pictures to be encoded in the GROUP OF 
PICTURES; 

(D) computing the reference value of a quantization parameter used for the 
quantization of each of macroblocks in the picture on the basis of the utilization 
capacity of a "virtual buffer" to perform the rate control; and 

(IH) modulating the reference value of the quantization parameter in accordance 
with the spatial activity in the macroblock. 

Furthermore, there are many types of decoders. For instance, a decoder is 
designed to decode the coded signal in a unique compression format different from that 
of the MPEG-2 bit stream, and another decoder is connectable to a transmitting path 
having a different bit rate. The decoder of those types is therefore required to provide 
with an apparatus, a so-called transcoder, for converting the MPEG-2 bit streams into 
another appropriate coded signal in a specified format having a required bit rate. The 
transcoder makes it possible for the encoder to transmit the coded signal to any types of 
decoders. 

Referring to FIG. 14 of the drawings, there is shown a transcoder of one typical 
type as a first conventional transcoder 50. The conventional transcoder 50 has an input 
terminal a 2 electrically connected to a first transmitting path, not shown, and an output 
terminal a 2 electrically connected to a second transmitting path, not shown. The 
conventional transcoder 50 is designed to input first bit streams bi at a predetermined 
input bit rate through the input terminal a x , to convert the first bit streams b x into second 
bit streams to be outputted at a predetermined output bit rate, i.e., a target bit rate, 
lower than the input bit rate of the inputted first bit streams bi, and then to output the 
second bit streams b 2 through the output terminal a 2 . The conventional transcoder 50 
comprises a variable length decoder 51, referred to as "VLD" in the drawings, an 
inverse quantizer 53, referred to as "IQ" in the drawings, a quantizer 55, referred to as 
"Q" in the drawings, a variable length encoder 57, referred to as "VLC" in the drawings, 



and a rate controller 59. 

The variable length decoder 51 is electrically connected to the input terminal a r 
and designed to decode a coded moving picture sequence signal within the first bit 
streams bi inputted through the input terminal ai to reconstruct original picture data for 
5 each of pictures including a matrix of original quantization coefficients, referred to as 
"level", for each of macroblocks within each of the pictures and an original quantization 
parameter, hereinlater referred to as "first quantization parameter Qi". 

The inverse quantizer 53 is electrically connected to the variable length 
decoder 51 and designed to input the matrix of original quantization coefficients level 
10 from the variable length decoder 51 and the first quantization parameter Qi. The 
inverse quantizer 53 is further designed to inversely quantize the inputted matrix of 
original quantization coefficients level with the first quantization parameter Qi to 
generate a matrix of inverse-quantization coefficients, referred to as "dequant", i.e., 
DCT coefficients, for each of macroblocks as follows: 

15 dequant = {2 x level + sign(level)}x — .equation (al) 

or 

, , , , QiXQM 

dequant = level x — . . . equation (a2) 

16 

where the equation (al) is used for the intra-picture while the equation (a2) is 
used for the inter-picture. QM is a matrix of quantization parameters stored in a 

20 predetermined quantization table. The first quantization parameter Ch and the matrix 
of quantization parameters QM are derived from the inputted first bit streams bi by the 
decoder 51. Here, the original quantization coefficients level, the inverse-quantization 
coefficients dequant, the matrix of quantization parameters QM, and the first 
quantization parameter Q x are integers. The inverse-quantization coefficients dequant 

25 calculated by the equations (al) and (a2) should be rounded down to the nearest integer. 

The quantizer 55 is electrically connected to the inverse quantizer 53 and 
designed to input the matrix of inverse-quantization coefficients dequant from the 
inverse quantizer 53 and then quantize the inputted matrix of inverse-quantization 
coefficients dequant for each of macroblocks with a second quantization parameter, 

30 referred to as "Q 2 " hereinlater, to generate a matrix of re-quantization coefficients, 
referred to as "tlevel", as follows: 

tlevel — dequant x — • • • equation (a3 ) 

or 
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tie vel = dequantx — + sign{dequanf) x — ... equation (a4) 

<2 2 X<2M 2 

where the equation (a3) is used for the inter-picture, while the equation (a4) is 
used for the intra-picture. The second quantization parameter Q 2 is obtained by the 
rate controller 59. Here, the re-quantization coefficients tlevel and the second 
5 quantization parameter Q 2 are also integers. The re-quantization coefficients tlevel 
calculated by the equations (a3) and (a4) should be rounded down to the nearest integer. 
Such rounding operation for the integers will be omitted from the later description for 
avoiding tedious repetition. 

The variable length encoder 57 is electrically connected to the quantizer 55 and 
10 designed to input the re-quantization coefficients tlevel from the quantizer 55 and then 
encode the inputted matrix of the re-quantization coefficients tlevel to generate 
objective picture data for each of pictures to sequentially output the objective picture 
data in the form of the second bit streams bi through the output terminal a 2 . The 
variable length encoder 57 is further electrically connected to the variable length 
15 decoder 51 and designed to input a diversity of information data included in the first bit 
streams bi necessary for the second bit streams b 2 from the variable length decoder 51. 

The rate controller 59 is electrically connected to the inverse quantizer 53 and 
designed to perform rate control process in accordance with the TM-5 on the basis of 
the information obtained from the inverse quantizer 53 as described below. 
20 Referring to FIG. 15 of the drawings, there is shown a flowchart of the rate 

controlling process in accordance with the TM-5 carried out in the conventional 
transcoder 50. As shown in FIG. 15, the rate controlling process comprises steps Al 
to A14. 

In the step Al, "1" is assigned to a picture number variable n representing the 
25 serial number of a picture within the first bit streams bi. Hereinlater, a n-th picture in 
the first bit streams h x is referred to as "pic(n)". 

In the following step A2, a global complexity measure, referred to as X s , X p , or 
X b , for a picture of the corresponding type, i.e., I, P or B-picture is computed as follows: 

30 Xi=SiXQi ...equation (a5) 



or 



or 



Xp-SpXQ p equation (a6) 

X b =Sb x Qb . . . equation (a7) 



35 



5 



where Si, Sp, or S b is the number of bits generated for an encoded I, P or 
B-picture, and Qj, Q p , or Q b is the average quantization parameter computed by 
averaging the actual quantization values used during the quantization of the all 
macroblocks within I, P or B-picture. The average quantization parameters Q b Q p , 
5 and Q b are normalized within a range of 1 to 3 1 . The average quantization parameters 
Qi, Q p , and Q b respectively correspond to the first quantization parameters Qi obtained 
from the variable length decoder 51. 

The global complexity measure X i( X p , or X b of the corresponding picture is 
inversely proportional to the compressing ratio of the moving picture, namely, the ratio 
10 of the amount of information in the second bit streams b2 to that in the first bit streams 
bi. Namely, as the amount of information in the first bit streams b x becomes larger, 
the compressing ratio is decreased. Therefore, the global complexity measure X i} X p , 
or X b of the corresponding picture becomes larger, as the compressing ratio is decreased. 
In contrast, the global complexity measure Xt, Xp, or X b of the corresponding picture 
15 becomes smaller, as the compressing ratio is increased. 

The initial value of global complexity measure X i? X p , or X b of the 
corresponding picture is given as follows: 



20 or 



or 



Xi=160xTarget_Bitrate/115 ...equation (a8) 

X p =60XTarget_Bitrate/l 15 ... equation (a9) 

X b =42xTarget_Bitrate/l 15 ... equation (al 0) 



25 where Target_Bitrate is measured in bits/s and corresponds to the target bit 

rate of the first conventional transcoder 50. 

In the following step A3, the target number of bits for a picture of the 
corresponding type, i.e., I, P or B-pictuie to be encoded in the current GROUP OF 
PICTURES, referred to as Ti, T p , or T b is computed as: 

R 



1+ N p X p . N b x b 



30 X ' K > X i K * ...equation (all) 



or 
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R 




...equation (a 12) 



or 



R 




...equation (al3) 



where N p and N b are the number of P-pictures and B -pictures remained not yet 



5 encoded in the current GROUP OF PICTURES, respectively. K p and K b are constants 
computed on the basis of the ratio of the quantization value of P-picture to the 
quantization value of I-picture, and the ratio of the quantization parameter of B-picture 
to the quantization value of I-picture, respectively. It is assumed that the quality of the 
whole image will be always optimized with K p =l .0 and K b =l .4. 

10 In the following step A4, it is judged upon whether the picture number variable 

n is "1" or not, i.e., the current picture is the first picture pic(l) or not. When it is 
judged that the picture number variable n is "1", i.e., the current picture is the first 
picture pic(l), the step A4 goes forward to the step A5. When, on the other hand, it is 
judged that the picture number variable n is not "1", i.e., the current picture is not the 

15 first picture, the step A4 goes forward to the step A6. Jn the step A5, the total number 
of bits available to the pictures to be encoded in the current GROUP OF PICTURES, 
i.e., the remaining number of bits available to the GROUP OF PICTURES, hereinlater 
referred to as R, is initialized in accordance with the following equation (al4). This 
remaining number of bits available to the GROUP OF PICTURES R before encoding 

20 the first picture pic(l) within the GROUP OF PICTURES is computed as follows: 



where NPIC is the total number of pictures of any type in the GROUP OF 
25 PICTURES, and picturejrate is expressed in the number of pictures decoded and 
indicated per second. At the start of the sequence R=0. 

hi the step A6, the above remaining number of bits available to the GROUP OF 
PICTURES R before encoding the current picture pic(n) is updated as follows: 

30 R=R-Si ...equation (al5) 



R=Target_BitratexNPIC/picture_rate+R 



...equation (al4) 
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or 

R=R-S P ...equation (al6) 

or 

R=R-Sb ...equation (al7) 

where Si, S p , or S b is the number of bits generated in the previously encoded 
picture pic(n-l) of the corresponding type (I, P or B). 

The step A5 or A6 goes forward to the step A7 wherein "1" is assigned to a 
macroblock number variable j (j>=l) representing the serial number of a macroblock 
within one of the pictures. Hereinlater, the j-th macroblock in the picture is referred to 
as "MB(j)". 

In the following step A8, a utilization volume of the capacity of a virtual buffer 
for I, P or B-pictures, referred to as dj(j), d p (j) or d b (j), before encoding the macroblock 
MB(j) is computed as follows: 

T t xU-Q 



or 



or 



d i U) = d i (0) + BU-D- MliA7} 

NMB ...equation (al8) 

d p U) = d p (0) + B(j-l)- 



T p xU~l) 



d b U) = d b (0) + BU-D- 



NMB ...equation (al9) 



NMB ...equation (a20) 

where B(j-1) is the total number of bits generated for encoded macroblocks in 
the picture up to and including the (j-l)th macroblock MB(j-l). NMB is the total 
number of macroblocks in the picture. di(j), d p (j)> or d b (j) is the utilization volume of 
the capacity of the virtual buffer at the j-th macroblock MB(j) for I, P, or B-picture. 

dj(0), d p (0), or db(o) is the initial utilization volume of the virtual buffer for I, P, 
or B-picture and given by: 

<f/(0)=10Xr/3 1 .equation (a21) 

or 

dp(Oy=KpXdi(0) ...equation (a22) 

or 

d m =K b *d { (0) . . .equation (a23) 

where r is referred to as "reaction parameter" and used for the control of the 
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reaction rate of the feed back loop as follows: 



r=2X-Target_BitrateIpicture_rate ...equation (a24) 

5 The final utilization volume of the virtual buffer, referred to as, di(NMB), 

dp(NMB), or d„(NMB) of the last macroblock, i.e., NMB-th macroblock MB(NMB) of 
the current picture pic(n) will be used as the initial utilization volume of the virtual 
buffer for I, P, or B-picture, i.e., di(0), d p (0), or d K o) of the same type to encode the first 
macroblock MB(1) within the next picture pic(n+l). 
10 In the following step A9, the reference quantization parameter Q(j) of the j-th 

macroblock MB(j) for each of the pictures is computed on the basis of the aforesaid 
utilization volume of the virtual buffer, i.e., d(j) as follows: 

Q(j)=d(j) x 3 1/r . . .equation (a25) 

15 

Here, the reference quantization parameter Q(j) is identical with the aforesaid 

second quantization parameter Q 2 of the j-th macroblock MB(j). 

In the following step A10, the j-th macroblock MB(j) is quantized with the 

reference quantization parameter Q(j) computed in the step A9. In the following step 
20 All, the macroblock number variable j is incremented by one. The step All goes 

forward to the step A12 wherein it is judged upon whether the macroblock number 

variable j is more than the total number of macroblocks NMB within the n-th picture 

pic(n) or not. When it is judged that the macroblock number variable j is not more 

than the total number of macroblocks NMB within the n-th picture pic(n), the step A12 
25 returns to the step A8. When, on the other hand, it is judged that the macroblock 

number variable j is more than the total number of macroblocks NMB within the n-th 

picture pic(n), the step A12 goes forward to the step A13. 

The macroblock number variable j thus serves as a loop counter for repeating 

the process from the steps A8 to All to encode all the macroblocks from the 1st 
30 macroblock MB(1) up to the j-th macroblock MB(j) in the present picture pic(n). The 

entire macroblocks starting from the first macroblock MB(1) up to the NMB-th 

macroblock MB(NMB) in the n-th picture pic(n) can be thus encoded sequentially. 

In the step A13, the picture number variable n is incremented by one. Then 

the step A13 goes forward to the step A14 wherein it is judged upon whether the picture 
35 number variable n is more than the total number of pictures, i.e., NPIC or not. When 

it is judged that the picture number variable n is not more than the total number of 



9 



pictures, NPIC, the step A14 returns to the step A2. When, on the other hand, it is 
judged that the picture number variable n is more than the total number of pictures, 
NPIC, this routine of the rate controlling process is terminated. The picture number 
variable n thus serves as a loop counter for repeating the process from steps A2 to A13 
to process all the pictures from the first picture pic(l) to the n-th picture pic(n) in the 
present GROUP OF PICTURES. The entire pictures starting from the first picture 
pic(l) up to the NPIC-th picture pic(NPIC), in the present GROUP OF PICTURES can 
be therefore processed sequentially. 

The aforesaid conventional transcoder 50, however, can obtain no information 
on the structure of GROUP OF PICTURES such as a picture cycle of I or P-pictures 
within each of the GROUP OF PICTURES, so that the transcoder 50 must estimate the 
structure of GROUP OF PICTURES within the inputted moving picture sequence signal 
to allocate the number of bits to pictures of each type within the estimated structure of 
GROUP OF PICTURES. 

Furthermore, the first conventional transcoder 50 is required to decode the first 
bit streams b x almost all over the layers such as the sequence layer, the GROUP OF 
PICTURES layer, the picture layer, the slice layer and the macroblock layer in order to 
derive necessary data for transcoding the first bit streams bi into the second bit streams 
b 2 . The operation takes time, thereby causing the delay in the transcoding process. 

Referring to FIG. 16 of the drawings, there is shown an improvement of the 
above transcoder 50 as a second conventional transcoder 60. The second conventional 
transcoder 60 is operated to perform the rate control without estimating the structure of 
GROUP OF PICTURES. As shown in FIG. 16, the second conventional transcoder 60 
comprises a delay circuit 61 and a rate controller 62 in addition to the variable length 
decoder 51, the inverse quantizer 53, the quantizer 55 and the variable length encoder 
57 same as those of the first conventional transcoder 50 shown in FIG. 14. The same 
constitutional elements are simply represented by the same reference numerals as those 
of the conventional transcoder 50, and will be thus omitted from description for 
avoiding tedious repetition. 

The delay circuit 61 is interposed between the variable length decoder 51 and 
the inverse quantizer 53 and designed to control the flow of the signal from the variable 
length decoder 51 to the inverse quantizer 53. The delay circuit 61 is operated to delay 
the operation start time of the inverse quantizer 53 so that the inverse quantizer 53 does 
not start the inverse-quantizing process until the variable length decoder 51 terminates 
the process of decoding one of the pictures in the coded moving picture sequence signal. 

As shown in FIG. 16, the rate controller 62 of the second conventional 
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transcoder 60 includes a target ratio computing unit 63, an input bit summing unit 65, a 

bit difference computing unit 67, a target output bit updating unit 69, and a quantization 

parameter computing unit 7 1 . 

The target ratio computing unit 63 is electrically connected to the variable 

length decoder 51 and designed to input an input bit rate of the first bit streams b 1? 

hereinlater referred to as "Input_Bitrate", from the variable length decoder 51, and 

input a target bit rate, hereinlater referred to as "Target_Bitrate" through a terminal a 3 . 

Alternatively, the target bit rate Target_Bitrate may have been stored in an internal 

memory, or determined on the basis of internal switches. The target ratio computing 

unit 63 is designed to then compute a target ratio, hereinlater referred to as "ioRatio" of 

the target bit rate Target_Bitrate to the input bit rate Input_Bitrate for each of pictures 

as follows: 

. „ . Target Bitrate 
ioRatio = - 

Input Bitrate .. ., „,-s 

y - ...equation (a26) 

The input bit summing unit 65 is designed to sum up the number of inputting 
bits of the picture decoded by the variable length decoder 51 to produce the total 
number of inputting bits, hereinlater referred to as "Tin". On the other hand, the target 
output bit updating unit 69 is designed to compute a target number of outputting bits to 
be generated by the variable length encoder 57, hereinlater referred to as "T out ". The 
target number of outputting bits T on t is computed by multiplying the total number of 
inputting bits Ti„ by the target ratio ioRatio as follows: 

T 0 ut=Tm x ioRatio . . . equation (a27) 

The bit difference computing unit 67 is electrically connected to the variable 
length encoder 57 and the target output bit updating unit 69, and designed to input a real 
number of outputting bits encoded by the variable length encoder 57, hereinlater 
referred to as "T real ", and input the target number of outputting bits T ont . The bit 
difference computing unit 67 is designed to then compute a difference between the 
target number of outputting bits T ou t and the real number of outputting bits T^, 
hereinlater referred to as a "difference number of bits", i.e., "Tdar" as follows: 

TdijpTreai-Tout .. .equation (a28) 

The target output bit updating unit 69 is electrically connected to the target 
ratio computing unit 63, the input bit summing unit 65, and the bit difference computing 
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unit 67. The target output bit updating unit 69 is designed to update the target number 
of outputting bits T out on the basis of the difference number of bits Tdiff as follows: 

Toot^Tout-Tdiff ...equation (a29) 

5 

The quantization parameter computing unit 71 is electrically connected to the 
target output bit updating unit 69 and designed to compute the reference quantization 
parameter Q(j) for each of macroblocks MB(j) on the basis of the target outputting bits 
T ont updated by the target output bit updating unit 69 in accordance with the step II of 
10 the TM-5. 

FIG. 17 shows the flowchart of the rate controlling process performed by the 
above conventional transcoder 60. The rate controlling process performed in the 
transcoder 60 comprises the steps Bl to B13. The steps B6 to B13 are almost the same 
as those of the steps A7 to A14, respectively, in the rate controlling process shown in 

15 FIG. 15 except for the step B7 wherein the utilization volume of the capacity of the 
virtual buffer is computed on the basis of the target number of outputting bits T on t given 
by the target output bit updating unit 69 instead of the target number of bits T h T p or T b 
computed in the step A3 shown in FIG. 15. The same steps will be thus omitted from 
description for avoiding tedious repetition. 

20 In the step Bl, "1" is assigned to the picture number variable n. The step Bl 

then goes forward to the step B2 wherein the target ratio ioRatio is computed by the 
above equation (a26). In the following step B3, the difference number of bits is 
computed for the present picture pic(n) by the above equation (a28). The step B3 then 
goes forward to the step B4 wherein the number of inputting bits Ta, is summed up 

25 within the first bit streams bi. m the step B5, the target number of outputting bits T ont 
is computed by the above equation (a27), and further updated by the above equation 
(«29). 

Li the second conventional transcoder 60 thus constructed, the inverse 
quantizer 53, however, cannot start the inverse-quantization process until the target 
30 transcoding frame is completely decoded, thereby causing the delay in the transcoding 
process. 

Referring to FIGS. 18 and 19 of the drawings, there is shown another 
improvement of the above transcoder 50 as a third conventional transcoder 80. The 
third conventional transcoder 80 is also adaptable to perform the rate control without 
35 estimating the structure of GROUP OF PICTURES. As shown in FIG. 18, the third 
conventional transcoder 80 comprises an input terminal a x electrically connected to a 
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first transmitting path and designed to input an input bit streams b 3 at the input bit rate, 
and an output terminal a 2 electrically connected to a second transmitting path and 
designed to output an output bit streams b 4 at the target bit rate. Li the third 
conventional transcoder 80, the input bit streams b 3 may have a format, non-adaptable 
for the MPEG-2, different from that of the bit streams bi of the first and second 
conventional transcoders 50 and 60. The input bit streams lb have information on the 
number of coding bits previously recorded thereon by the encoder, not shown. 

The third conventional transcoder 80 comprises a variable length decoder 81 
electrically connected to the input terminal a lf and a rate controller 82 in addition to the 
inverse quantizer 53, the quantizer 55, and the variable length encoder 57 which are 
same in construction as those of the second transcoder 60 shown in FIG. 16. The rate 
controller 82 includes a target output bit updating unit 83, and a quantization parameter 
computing unit 85 in addition to the target ratio computing unit 63, and the bit 
difference computing unit 67 which are same as those of the second transcoder 60 
shown in FIG. 16. 

The third conventional transcoder 80 thus constructed can perform the rate 
control on the basis of the formation on the number of coding bits previously recorded 
in the input bit streams b 3 . The variable length decoder 81 is operated to decode the 
coded moving picture sequence signal within the third bit streams b 3 to reconstruct the 
pictures and the information on the number of coding bits, and transmit the information 
to the inverse quantizer 53. The variable length decoder 81 is also operated to transmit 
the number of inputting bits Tu, to the target output bit updating unit 83. 

The outputting bit updating unit 83 is designed to compute the target number of 
outputting bits T„ ut on the basis of the number of inputting bits T ta and the target ratio 
ioRatio by the above equation (a26). The quantization parameter computing unit 85 is 
designed to compute the reference quantization parameter Q(J) of the macroblocks 
MB(j) for each of pictures on the basis of the target number of outputting bits T out 
updated by the outputting bit updating unit 83 in accordance with the step n in the 
TM-5. The quantizer 55 is then operated to quantize the j-th macroblock MB(j) on the 
basis of the reference quantization parameter Q(j) given by the quantization parameter 
computing unit 85. 

FIG. 19 shows the flowchart of the rate controlling process performed by the 
above third conventional transcoder 80. The rate controlling process performed in the 
transcoder 80 comprises the steps CI to C13. All the steps CI to C13 are the same as 
those of the steps Bl to B13, respectively, in the rate controlling process shown in FIG. 
17 except for the step C4 wherein the number of inputting bits in the current picture 
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pic(n) is derived from the third bit streams b 3 by the decoder 81 to compute the total 
number of inputting bits Tj„. 

The third conventional transcoder 80 thus constructed has information on the 
number of coding bits previously recorded in the third bit streams b3 thereby making it 
5 possible to solve the problem of the delay in the second conventional transcoder 60. 
The third conventional transcoder 80, however, encounters another problem to restrict 
the form of the inputted bit streams. Moreover, the encoder which is linked with the 
third transcoder 80 must provide with the above information on the number of coding 
bits to be recorded in the bit streams, thereby causing the delay of process in the 
10 encoder. 

hi the conventional transcoders 50, 60 and 80, the matrix of the 
inverse-quantization coefficients dequant is necessary for only the quantizer 55, but 
unnecessary for the transcoder itself to generate the desired bit streams. Jh order to 
ehininate the redundant matrix of the inverse-quantization coefficients dequant, there is 

15 proposed a fourth conventional transcoder 90 comprising a level converter 91 instead of 
the inverse quantizer 53 and the quantizer 55 of the transcoder 50, as shown in FIG. 20. 

The level converter 91 is interposed between the variable length decoder 51 
and the variable length encoder 57. The level converter 91 is designed to input the 
original picture data for each of pictures. The original picture data includes a matrix of 

20 original quantization coefficients level for each of macroblocks within the 
corresponding picture. The level converter 91 is electrically connected to the rate 
controller 59 and designed to input the second quantization parameter Q 2 from the rate 
controller 59. 



25 for each of pictures including the matrix of original quantization coefficients level into 
the objective picture data including the matrix of re-quantization coefficients tlevel 
without generating the matrix of the inverse-quantization coefficients dequant. The 
following equations (30a) and (31a) for the matrix of re-quantization coefficients tlevel 
are lead by eliminating the matrix of the inverse-quantization coefficients dequant from 

30 the above equations (al), (a2), (a3) and (a4). 



The level converter 91 is further designed to convert the original picture data 




...equation (30a) 



or 




•2 



where the above equation (30a) is used for the inter-picture, while the above 
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equation (31a) is used for the intra-picture. The level converter 91 is thus operable to 
convert the original picture data, for each of pictures, into the second picture data with 
the first quantization parameter Q t and the second quantization parameter Q 2 . The 
first quantization parameter Qi is decoded from the first bit streams bi by the variable 
5 length decoder 51, while the second quantization parameter Q 2 is obtained from the rate 
controller 59. 

In the fourth conventional transcoder 90, the rate controller 59 is designed to 
perform the rate control over the encoding process in the transcoder 90 according to the 
TM-5. The variable length encoder 57 is electrically connected to the level converter 
10 91 and to input the above matrix of re-quantization coefficients tlevel from the level 
converter 91. 

The fourth conventional transcoder 90 thus constructed can efficiently perform 
the transcoding process at high speed without storing the matrix of inverse-quantization 
coefficients dequant in a memory. 

15 The above conventional transcoders 50, 60, 80 and 90, however, encounter 

another problem with the rate-distortion performance in converting the quantization 
level occurred as a result of the re-quantization operation since they cannot obtain all 
the information on original picture data before the quantization operation. In short, the 
rate-distortion performance in converting the quantization level is unstable and variable 

20 in accordance with the first and second quantization parameters and the level of the 
original quantization coefficients level. Therefore, as the amount of reduced 
information becomes larger, the quantization error is liable to increase, thereby causing 
unstable rate control in transcoding. 

The applicant of the present application filed a US Patent Application No. 

25 09/604,973 on June 28, 2000. 

The applicant disclosed therein an apparatus, a method and a computer 
program product for transcoding a coded moving picture sequence signal, being 
operable to compute an optimized re-quantization parameter on the basis of the 
inverse-quantization parameter and the previously computed re-quantization parameter 

30 in consideration of the characteristics of the rate-distortion performance dependent on 
the re-quantization parameter and the inverse-quantization parameter. 

The apparatus disclosed therein comprising an inverse quantizer for performing 
the inverse-quantization operation and a quantizer for performing the quantization 
operation, is characterized in that the apparatus further comprises quantization 

35 parameter switching means for switching the quantization parameter in consideration of 
the characteristics of the rate-distortion performance dependent on the inputted 
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quantization parameter, thereby making it possible for the apparatus to minimize the 
quantization error occurred when the matrix of original quantization coefficients is 
transformed to the matrix of re-quantization coefficients. 

In the meantime, different techniques have been found such as data partitioning 
and SNR scalability for dividing picture signals conveying picture information into two 
separate picture signals consisting of base layer picture signal indicative of basic picture 
information and enhancement layer picture signal indicative of high quality picture 
information in order to prevent the quality of picture from deteriorating. 

More particularly, the data partitioning provides a method of dividing bit 
streams conveying picture information into two separate bit streams consisting of base 
layer bit streams conveying low-frequency DCT coefficients and enhancement layer bit 
streams conveying high-frequency DCT coefficients before encoding, and the base layer 
bit streams and enhancement layer bit streams thus divided are recombined before 
decoding. Original picture information can be roughly decoded and reproduced from 
the base layer bit streams conveying low-frequency DCT coefficients, but not from the 
enhancement layer bit streams conveying high-frequency DCT coefficients alone. The 
high-quality original picture information can be decoded and reproduced from the 
recombination of the base layer bit streams conveying low-frequency DCT coefficients 
and the enhancement layer bit streams conveying high-frequency DCT coefficients. 

The SNR scalability provides a method of dividing picture signals containing 
picture information into two separate picture signals consisting of base layer picture 
signals containing low-SNR image information and enhancement layer picture signals 
containing auxiliary information before encoding. The method of SNR scalability will 
be described in detail. The original picture signals have original DCT coefficients. 
The quantizer is operated to roughly quantize base layer bit picture signals containing 
low-SNR image information to generate low-SNR bit streams. The inverse quantizer 
is operated to inversely quantize the low-SNR bit streams thus generated to roughly 
reproduce DCT coefficients. Then, the difference information between the original 
DCT coefficients and the reproduced DCT coefficients is extracted and quantized to 
generate the enhancement layer picture signals. The enhancement layer picture signals 
thus generated are used as auxiliary information in combination with the base layer 
picture signals (low-SNR signals) to reproduce high-SNR signals. 

The above described methods, however, encounter a problem of reducing the 
quality of service, i.e., QoS. The transcoding process above described is 
non-reversible. The transcoder, in general, is operated to decode and inversely 
quantize DCT coefficients of input bit streams and re-quantize the DCT coefficients 



16 



thus inversely quantized with re-quantization parameters greater then the original 
quantization parameters to reduce the bit rate. This means that the input bit streams 
before the transcoding operation cannot be reproduced from the transcoded bit streams. 
This leads to the fact that the QoS for the input bit streams cannot be reproduced. 
5 The data partitioning method permits to divide bit streams into two separate bit 

streams consisting of base layer bit streams indicative of low-frequency DCT 
coefficients and enhancement layer bit streams indicative of high-frequency DCT 
coefficients before encoding. There is, however, provided no method of dividing 
MPEG-2 bit streams in conformance with MP@ML, which are not in a hierarchical 
10 structure, into base layer bit streams and enhancement layer bit streams. Furthermore, 
although the data partitioning method may permit to divide bit streams into the base 
layer bit streams and enhancement layer bit streams before encoding, a decoder 
conforming to MP@ML cannot decode the base layer bit streams and enhancement 
layer bit streams thus divided. 

15 According to the syntax of the data partitioning, the code specifying a 

boundary between low-frequency coefficients and high-frequency coefficients is 
defined as "Priority_break_point", which makes it possible for a decoder to distinguish 
the low-frequency coefficients from the high-frequency coefficients. The decoder 
conforming to MP@ML, on the other hand, cannot recognize "Priority_break_point". 

20 Furthermore, the bit streams indicative of low-frequency coefficients include no EOB 
code, thereby making it impossible for the MP@ML decoder to reproduce the bit 
streams indicative of low-frequency coefficients. This leads to the fact that the data 
partitioning method requires a decoder dedicated to the data partitioning method in 
place of the decoder confonning to MP@ML. 

25 Similarly to the data partitioning, the SNR scalability method permits to divide 

bit streams into two separate bit streams consisting of base layer bit streams containing 
low-SNR signals and enhancement layer bit streams containing the auxiliary 
information before encoding. An encoder conforming to MP@ML, however, cannot 
divide bit streams into base layer bit streams containing low-SNR signals and 

30 enhancement layer bit streams containing the auxiliary information and encode the base 
layer bit streams and enhancement layer bit streams thus divided. Nor can a decoder 
conforming to MP@ML decode the base layer bit streams and the enhancement layer 
bit streams. This leads to the fact that the SNR scalability method requires an encoder 
and a decoder dedicated to the SNR scalability in place of the encoder and decoder 

35 conforming to MP@ML. 

Furthermore, the base layer bit streams and the enhancement layer bit streams 
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are required to be processed in parallel, thereby making it complex and difficult to 
design such SNR scalability conformable encoder and decoder. Moreover, the SNR 
scalability conformable decoder is operated to receive the base layer bit streams and the 
enhancement layer bit streams to reproduce and output original picture signals but not in 
the form of bit streams. This means that the picture signal thus reproduced and 
outputted must be transcoded again if it is required be in the form of bit streams. 

That the above data partitioning and SNR scalability operations require 
respective dedicated encoders and decoders is attributed to the fact that the respective 
decoders and encoders are operative to perform the process of dividing bit streams into 
base layer bit streams and the enhancement layer bit streams, and the process of 
recombining the base layer bit streams and the enhancement layer bit streams to 
reconstruct original bit streams. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide an apparatus for 
transcoding a first coded moving picture sequence signal to separate into and generate a 
second coded moving picture sequence signal and a differential coded moving picture 
sequence signal, which is a difference between the first coded moving picture sequence 
signal and the second coded moving picture sequence signal. 

It is another object of the present invention to provide a method of transcoding 
a first coded moving picture sequence signal to separate into and generate a second 
coded moving picture sequence signal and a differential coded moving picture sequence 
signal, which is a difference between the first coded moving picture sequence signal and 
the second coded moving picture sequence signal. 

It is further object of the present invention to provide a computer program 
product for transcoding a first coded moving picture sequence signal to separate into 
and generate a second coded moving picture sequence signal and a differential coded 
moving picture sequence signal, which is a difference between the first coded moving 
picture sequence signal and the second coded moving picture sequence signal. 

It is a still further object of the present invention to provide an apparatus for 
merging a second coded moving picture sequence signal and a differential coded 
moving picture sequence signal, which is a difference between the first coded moving 
picture sequence signal and a second coded moving picture sequence signal, to 
reconstruct the first coded moving picture sequence signal. 

It is a yet further object of the present invention to provide a method of 
merging a second coded moving picture sequence signal and a differential coded 
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moving picture sequence signal, which is a difference between the first coded moving 
picture sequence signal and a second coded moving picture sequence signal, to 
reconstruct the first coded moving picture sequence signal. 

It is further object of the present invention to provide a computer program for 
merging a second coded moving picture sequence signal and a differential coded 
moving picture sequence signal, which is a difference between the first coded moving 
picture sequence signal and a second coded moving picture sequence signal, to 
reconstruct the first coded moving picture sequence signal. 

In accordance with a first aspect of the invention, there is provided a coded 
signal separating and merging system comprising: a coded signal separating apparatus 
for inputting a first coded moving picture sequence signal to separate into a second 
coded moving picture sequence signal and a differential coded moving picture sequence 
signal; and a coded signal merging apparatus for inputting the second coded moving 
picture sequence signal and the differential coded moving picture sequence signal to 
reconstruct the first coded moving picture sequence signal. 

The aforesaid coded signal separating apparatus includes: inputting means for 
inputting the first coded moving picture sequence signal therethrough, the first coded 
moving picture sequence signal generated as a result of encoding original moving 
picture sequence signal and consisting of a series of first picture information having first 
coefficient information, the first coefficient information including a matrix of first 
coefficients; coded signal converting means for converting the first coded moving 
picture sequence signal inputted through the inputting means to generate the second 
coded moving picture sequence signal, the second coded moving picture sequence 
signal consisting of a series of second picture information having second coefficient 
information, the second coefficient information including a matrix of second 
coefficients, each of the first coded moving picture sequence signal, and the second 
coded moving picture sequence signal is in the form of a hierarchical structure including 
one or more sequence layers each having a plurality of screens sharing common 
information, one or more picture layers each having a plurality of slices sharing 
common information with respect to one of the screens, one or more slice layers each 
having a plurality of macroblocks with respect to one of the slices, one or more 
macroblock layers each having a plurality of blocks with respect to one of the 
macroblocks, and one or more block layers each having block information with respect 
to one of the blocks; differential coded signal generating means for inputting the first 
coded moving picture sequence signal and the second coded moving picture sequence 
signal from the coded signal converting means to generate a differential coded moving 
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picture sequence signal on the basis of the first coefficient information obtained from 
the series of first picture information of the first coded moving picture sequence signal, 
and the second coefficient information obtained from the series of the second picture 
information of the second coded moving picture sequence signal, the differential coded 
moving picture sequence signal being a difference between the first coded moving 
picture sequence signal and the second coded moving picture sequence signal; 
separating storage means for selectively storing the first coded moving picture sequence 
signal, the second coded moving picture sequence signal, and the differential coded 
moving picture sequence signal; and first transmission means for selectively 
transmitting the first coded moving picture sequence signal, the second coded moving 
picture sequence signal, and the differential coded moving picture sequence signal to 
the coded signal merging apparatus. 

The aforesaid coded signal merging apparatus includes first receiving means 
for receiving a base coded moving picture sequence signal transmitted by the first 
transmission means from the coded signal separating apparatus, the base coded moving 
picture sequence signal being any one of the first coded moving picture sequence signal, 
the second coded moving picture sequence signal, and the differential coded moving 
picture sequence signal; merging storage means for storing the base coded moving 
picture sequence signal received by the first receiving means; request signal 
determining means for determining a request signal for a requested coded moving 
picture sequence signal on the basis of the base coded moving picture sequence signal 
stored by the merging storage means; and request signal transmission means for 
transmitting the request signal for the requested coded moving picture sequence signal 
determined by the request signal deteirruning means to the coded signal separating 
apparatus. 

In the aforesaid coded signal separating apparatus may further include: request 
signal receiving means for receiving the request signal transmitted by the request signal 
transmission means from the coded signal merging apparatus; separating coded signal 
extracting means for extracting the requested coded moving picture sequence signal 
from the separating storage means in response to the request signal; and second 
transmission means for transmitting the requested coded moving picture sequence 
signal extracted by the separating coded signal extracting means to the coded signal 
merging apparatus. 

In the aforesaid coded signal merging apparatus may further include: second 
receiving means for receiving the requested coded moving picture sequence signal 
transmitted by the second transmission means from the coded signal separating 
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apparatus; merging coded signal extracting means for extracting the base coded moving 
picture sequence signal from the merging storage means; merging means for merging 
the base coded moving picture sequence signal extracted by the merging coded signal 
extracting means with the requested coded moving picture sequence signal received by 
the second receiving means on the basis of the second coefficient information obtained 
from the series of second picture information of the second coded moving picture 
sequence signal, and the differential coefficient information obtained from the 
differential coded signal to reconstruct the first coded moving picture sequence signal; 
and outputting means for inputting the reconstructed first coded moving picture 
sequence signal from the merging means to be outputted therethrough. 

m the above mentioned coded signal separating and merging system, the 
separating storage means of the coded signal separating apparatus is operative to store 
the differential coded moving picture sequence signal generated by the differential 
coded signal generating means, the first transmission means is operative to transmit the 
second coded moving picture sequence signal generated by the coded signal converting 
means, the first receiving means of the coded signal merging apparatus is operative to 
receive the second coded moving picture sequence signal transmitted by the first 
transmission means, the merging storage means is operative to store the second coded 
moving picture sequence signal received by the first receiving means, the request signal 
deterrnining means is operative to determine a request signal for a requested differential 
coded moving picture sequence signal on the basis of the second coded moving picture 
sequence signal stored by the merging storage means, the request signal transmission 
means is operative to transmit the request signal for the requested differential coded 
moving picture sequence signal determined by the request signal determining means, 
the request signal receiving means of the coded signal separating apparatus is operative 
to receive the request signal transmitted by the request signal transmission means, the 
separating coded signal extracting means is operative to extract the requested 
differential coded moving picture sequence signal from the separating storage means in 
response to the request signal, the second transmission means is operative to transmit 
the requested differential coded moving picture sequence signal extracted by the 
separating coded signal extracting means to the coded signal merging apparatus, the 
second receiving means of the coded signal merging apparatus is operative to receive 
the requested differential coded moving picture sequence signal transmitted by the 
second transmission means from the coded signal separating apparatus, the merging 
coded signal extracting means is operative to extract the second coded moving picture 
sequence signal from the merging storage means, and the merging means is operative to 
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merge the second coded moving picture sequence signal extracted by the merging coded 
signal extracting means with the requested differential coded moving picture sequence 
signal received by the second receiving means to reconstruct the first coded moving 
picture sequence signal. 
5 In the above mentioned coded signal separating and merging system, the coded 

signal merging apparatus further includes second coded moving picture sequence signal 
decoding means for decoding the second coded moving picture sequence signal 
received by the first receiving means. 

In the above mentioned coded signal separating and merging system, the coded 
10 signal merging apparatus further includes editing means for cutting and combining 
component parts of the second coded moving picture sequence signal stored by the 
merging storage means to generate an edited second coded moving picture sequence 
signal in a desired size, the request signal determining means is operative to determine a 
request signal for a requested differential coded moving picture sequence signal on the 
15 basis of the edited second coded moving picture sequence signal generated by the 
editing means, the request signal transmission means is operative to transmit the request 
signal for the requested differential coded moving picture sequence signal determined 
by the request signal determining means to the coded signal separating apparatus, the 
separating coded signal extracting means of the separating coded signal separating 
20 apparatus is operative to extract the requested differential coded moving picture 
sequence signal from the separating storage means in response to the request signal, and 
the merging means is operative to merge the edited second coded moving picture 
sequence signal generated by the editing means with the requested differential coded 
moving picture sequence signal received by the second receiving means to reconstruct 
25 the first coded moving picture sequence signal in the desired size. 

In the above mentioned coded signal separating and merging system, the 
separating storage means of the coded signal separating apparatus is operative to store 
the second coded moving picture sequence signal generated by the coded signal 
converting means, the first transmission means is operative to transmit the differential 
30 coded moving picture sequence signal generated by the differential coded signal 
generating means to the coded signal merging apparatus, the first receiving means of the 
coded signal merging apparatus is operative to receive the differential coded moving 
picture sequence signal transmitted by the first transmission means, the merging storage 
means is operative to store the differential coded moving picture sequence signal 
35 received by the first receiving means, request signal detemiining means is operative to 
determine a request signal for a requested second coded moving picture sequence signal 
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on the basis of the differential coded moving picture sequence signal stored by the 
merging storage means, the request signal transmission means is operative to transmit 
the request signal for the requested second coded moving picture sequence signal 
determined by the request signal determining means, the request signal receiving means 
of the coded signal separating apparatus is operative to receive the request signal 
transmitted by the request signal transmission means, the separating coded signal 
extracting means is operative to extract the requested second coded moving picture 
sequence signal from the separating storage means in response to the request signal, the 
second transmission means is operative to transmit the requested second coded moving 
picture sequence signal extracted by the separating coded signal extracting means to the 
coded signal merging apparatus, the second receiving means of the coded signal 
merging apparatus is operative to receive the requested second coded moving picture 
sequence signal transmitted by the second transmission means from the coded signal 
separating apparatus, the merging coded signal extracting means is operative to extract 
the differential coded moving picture sequence signal stored by the merging storage 
means, and the merging means is operative to merge the differential coded moving 
picture sequence signal extracted by the merging coded signal extracting means with the 
second coded moving picture sequence signal received by the second receiving means 
to reconstruct the first coded moving picture sequence signal. 

In the above mentioned coded signal separating and merging system, the first 
transmission means of the coded signal separating apparatus is operative to transmit the 
differential coded moving picture sequence signal by way of broadcasting. 

hi the above mentioned coded signal separating and merging system, the coded 
signal merging apparatus further includes reconstructed first coded signal storage means 
for storing the reconstructed first coded moving picture sequence signal reconstructed 
by the merging means. 

In the aforesaid coded signal separating and merging system, the coded signal 
merging apparatus further includes: decoding means for decoding the first coded 
moving picture sequence signal or the second coded moving picture sequence signal; 
and merging coded signal converting means for inputting the first coded moving picture 
sequence signal to generate the second coded moving picture sequence signal, the first 
transmission means of the coded signal separating apparatus is operative to transmit the 
first coded moving picture sequence signal, the separating storage means is operative to 
store the differential coded moving picture sequence signal generated by the differential 
coded signal generating means, the first receiving means of the coded signal merging 
apparatus is operative to receive the first coded moving picture sequence signal 
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transmitted by the first transmission means from the coded signal separating apparatus, 
the decoding means is operative to decode the first coded moving picture sequence 
signal received by the first receiving means, the merging coded signal converting means 
is operative to input the first coded moving picture sequence signal received by the first 
receiving means to generate the second coded moving picture sequence signal, the 
merging storage means is operative to store the second coded moving picture sequence 
signal generated by the merging coded signal converting means, the request signal 
determining means is operative to detennine a request signal for a requested differential 
coded moving picture sequence signal on the basis of the second coded moving picture 
sequence signal stored by the merging storage means, the request signal transmission 
means is operative to transmit the request signal for the requested differential coded 
moving picture sequence signal determined by the request signal detennining means to 
the coded signal separating apparatus, the request signal receiving means of the coded 
signal separating apparatus is operative to receive the request signal transmitted by the 
request signal transmission means from the coded signal merging apparatus, the 
separating coded signal extracting means is operative to extract the requested 
differential coded moving picture sequence signal from the separating storage means in 
response to the request signal, the second transmission means is operative to transmit 
the requested differential coded moving picture sequence signal extracted by the 
separating coded signal extracting means to the coded signal merging apparatus, the 
second receiving means of the coded signal merging apparatus is operative to receive 
the requested differential coded moving picture sequence signal transmitted by the 
second transmission means from the coded signal separating apparatus, the merging 
coded signal extracting means is operative to extract the second coded moving picture 
sequence signal from the merging storage means, and the merging means is operative to 
merge the second coded moving picture sequence signal extracted by the merging coded 
signal extracting means with the requested differential coded moving picture sequence 
signal received by the second receiving means to reconstruct the first coded moving 
picture sequence signal in the desired size. 

In the aforesaid coded signal separating and merging system, the coded signal 
merging apparatus further includes: decoding means for decoding the first coded 
moving picture sequence signal or the second coded moving picture sequence signal; 
and merging differential coded signal generating means for inputting the first coded 
moving picture sequence signal to generate the differential coded moving picture 
sequence signal. The first transmission means of the coded signal separating apparatus 
is operative to transmit the first coded moving picture sequence signal, 
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In the above mentioned coded signal separating and merging system, the 
separating storage means is operative to store the second coded moving picture 
sequence signal generated by the coded signal converting means, the first receiving 
means of the coded signal merging apparatus is operative to receive the first coded 
5 moving picture sequence signal transmitted by the first transmission means from the 
coded signal separating apparatus, the decoding means is operative to decode the first 
coded moving picture sequence signal received by the first receiving means, the 
merging differential coded signal generating means is operative to input the first coded 
moving picture sequence signal received by the first receiving means to generate the 

10 differential coded moving picture sequence signal, the merging storage means is 
operative to store the differential coded moving picture sequence signal generated by 
the merging coded signal converting means, the request signal determining means is 
operative to determine a request signal for a requested second coded moving picture 
sequence signal on the basis of the differential coded moving picture sequence signal 

15 stored by the merging storage means, the request signal transmission means is operative 
to transmit the request signal for the requested second coded moving picture sequence 
signal determined by the request signal determining means to the coded signal 
separating apparatus, the request signal receiving means of the coded signal separating 
apparatus is operative to receive the request signal transmitted by the request signal 

20 transmission means from the coded signal merging apparatus, the separating coded 
signal extracting means is operative to extract the requested second coded moving 
picture sequence signal from the separating storage means in response to the request 
signal, the second transmission means is operative to transmit the requested second 
coded moving picture sequence signal extracted by the separating coded signal 

25 extracting means to the coded signal merging apparatus, the second receiving means of 
the coded signal merging apparatus is operative to receive the requested second coded 
moving picture sequence signal transmitted by the second transmission means from the 
coded signal separating apparatus, the merging coded signal extracting means is 
operative to extract the differential coded moving picture sequence signal from the 

30 merging storage means, and the merging means is operative to merge the differential 
coded moving picture sequence signal extracted by the merging coded signal extracting 
means with the requested second coded moving picture sequence signal received by the 
second receiving means to reconstruct the first coded moving picture sequence signal in 
the desired size. 

35 In accordance with a second aspect of the present invention, there is provided a 

coded signal separating apparatus for inputting a first coded moving picture sequence 
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signal to separate into a second coded moving picture sequence signal and a differential 
coded moving picture sequence signal comprising: inputting means for inputting the 
first coded moving picture sequence signal therethrough, the first coded moving picture 
sequence signal generated as a result of encoding original moving picture sequence 
5 signal and consisting of a series of first picture information having first coefficient 
information, the first coefficient information including a matrix of first coefficients; 
coded signal converting means for converting the first coded moving picture sequence 
signal inputted through the inputting means to generate the second coded moving 
picture sequence signal, the second coded moving picture sequence signal consisting of 

10 a series of second picture information having second coefficient information, the second 
coefficient information including a matrix of second coefficients, each of the first coded 
moving picture sequence signal, and the second coded moving picture sequence signal 
is in the form of a hierarchical structure including one or more sequence layers each 
having a plurality of screens sharing common information, one or more picture layers 

15 each having a plurality of slices sharing common information with respect to one of the 
screens, one or more slice layers each having a plurality of macroblocks with respect to 
one of the slices, one or more macroblock layers each having a plurality of blocks with 
respect to one of the macroblocks, and one or more block layers each having block 
information with respect to one of the blocks; differential coded signal generating 

20 means for inputting the first coded moving picture sequence signal and the second 
coded moving picture sequence signal from the coded signal converting means to 
generate a differential coded moving picture sequence signal on the basis of the first 
coefficient information obtained from the series of first picture information of the first 
coded moving picture sequence signal, and the second coefficient information obtained 

25 from the series of the second picture information of the second coded moving picture 
sequence signal, the differential coded moving picture sequence signal being a 
difference between the first coded moving picture sequence signal and the second coded 
moving picture sequence signal; separating storage means for selectively storing the 
first coded moving picture sequence signal, the second coded moving picture sequence 

30 signal, and the differential coded moving picture sequence signal; first transmission 
means for selectively transmitting the first coded moving picture sequence signal, the 
second coded moving picture sequence signal, and the differential coded moving picture 
sequence signal; request signal receiving means for receiving a request signal indicative 
of a requested coded moving picture sequence signal to be transmitted, the request 

35 signal indicative of the requested coded moving picture sequence signal being 
detennined on the basis of the first coded moving picture sequence signal, the second 
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coded moving picture sequence signal, or the differential coded moving picture 
sequence signal; separating coded signal extracting means for extracting the requested 
coded moving picture sequence signal from the separating storage means in response to 
the request signal; and second transmission means for transmitting the requested coded 
moving picture sequence signal extracted by the separating coded signal extracting 
means. 

In the aforesaid coded signal separating apparatus, the separating storage 
means is operative to store the differential coded moving picture sequence signal 
generated by the differential coded signal generating means, the first transmission 
means is operative to transmit the second coded moving picture sequence signal 
generated by the coded signal converting means, the request signal receiving means is 
operative to receive the request signal indicative of a requested differential coded 
moving picture sequence signal to be transmitted, the request signal indicative of the 
requested differential coded moving picture sequence signal being determined on the 
basis of the second coded moving picture sequence signal, the separating coded signal 
extracting means is operative to extract the requested differential coded moving picture 
sequence signal from the separating storage means in response to the request signal, and 
the second transmission means is operative to transmit the requested differential coded 
moving picture sequence signal extracted by the separating coded signal extracting 
means. 

In the aforesaid coded signal separating apparatus, the request signal receiving 
means is operative to receive the request signal indicative of the requested differential 
coded moving picture sequence signal to be transmitted, the request signal indicative of 
the requested differential coded moving picture sequence signal being determined on 
the basis of an edited second coded moving picture sequence signal generated by cutting 
and combining component parts of the second coded moving picture sequence signal, 
the separating coded signal extracting means is operative to extract the requested 
differential coded moving picture sequence signal from the separating storage means in 
response to the request signal, and the second transmission means is operative to 
transmit the requested differential coded moving picture sequence signal extracted by 
the separating coded signal extracting means. 

hi the aforesaid coded signal separating apparatus, the separating storage 
means is operative to store the second coded moving picture sequence signal generated 
by the coded signal converting means, the first transmission means is operative to 
transmit the differential coded moving picture sequence signal generated by the 
differential coded signal generating means, the request signal receiving means is 
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operative to receive the request signal indicative of the requested second coded moving 
picture sequence signal to be transmitted, the request signal indicative of the requested 
second coded moving picture sequence signal being determined on the basis of the 
differential coded moving picture sequence signal, the separating coded signal 
5 extracting means is operative to extract the requested second coded moving picture 
sequence signal from the separating storage means in response to the request signal, and 
the second transmission means is operative to transmit the requested second coded 
moving picture sequence signal extracted by the separating coded signal extracting 
means. 

10 In the aforesaid coded signal separating apparatus, the first transmission means 

is operative to transmit the differential coded moving picture sequence signal by way of 
broadcasting. 

In the aforesaid coded signal separating apparatus, the first transmission means 
is operative to transmit the first coded moving picture sequence signal, the separating 

15 storage means is operative to store the differential coded moving picture sequence 
signal generated by the differential coded signal generating means, the request signal 
receiving means is operative to receive the request signal indicative of a requested 
differential coded moving picture sequence signal to be transmitted, the request signal 
indicative of the requested differential coded moving picture sequence signal being 

20 determined on the basis of a second coded moving picture sequence signal generated in 
accordance with the first coded moving picture sequence signal, the separating coded 
signal extracting means is operative to extract the requested differential coded moving 
picture sequence signal from the separating storage means in response to the request 
signal, and the second transmission means is operative to transmit the requested 

25 differential coded moving picture sequence signal extracted by the separating coded 
signal extracting means. 

In the aforesaid coded signal separating apparatus, the first transmission means 
is operative to transmit the first coded moving picture sequence signal, the separating 
storage means is operative to store the second coded moving picture sequence signal 

30 generated by the coded signal converting means, the request signal receiving means is 
operative to receive the request signal indicative of a requested second coded moving 
picture sequence signal to be transmitted, the request signal indicative of the requested 
second coded moving picture sequence signal being determined on the basis of a 
differential coded moving picture sequence signal generated in accordance with the first 

35 coded moving picture sequence signal, the separating coded signal extracting means is 
operative to extract the requested second coded moving picture sequence signal from 
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the separating storage means in response to the request signal, and the second 
transmission means is operative to transmit the requested second coded moving picture 
sequence signal extracted by the separating coded signal extracting means. 

In accordance with a third aspect of the present invention, there is provided a 
5 coded signal merging apparatus for inputting a second coded moving picture sequence 
signal and a differential coded moving picture sequence signal to reconstruct a first 
coded moving picture sequence signal, the second coded moving picture sequence 
signal generated as a result of transcoding the first coded moving picture sequence 
signal and consisting of a series of second picture information having second coefficient 

10 information, the second coefficient information including a matrix of second 
coefficients, the first coded moving picture sequence signal generated as a result of 
encoding original moving picture sequence signal and consisting of a series of first 
picture information having first coefficient information, the first coefficient information 
including a matrix of first coefficients, the differential coded moving picture sequence 

15 signal being a difference between the first coded moving picture sequence signal and 
the second coded moving picture sequence signal, the differential coded moving picture 
sequence signal including differential coefficient information between the first 
coefficient information and the second coefficient information, each of the first coded 
moving picture sequence signal, the second coded moving picture sequence signal, and 

20 the differential coded moving picture sequence signal is in the form of a hierarchical 
structure including one or more sequence layers each having a plurality of screens 
sharing common information, one or more picture layers each having a plurality of 
slices sharing common information with respect to one of the screens, one or more slice 
layers each having a plurality of macroblocks with respect to one of the slices, one or 

25 more macroblock layers each having a plurality of blocks with respect to one of the 
macroblocks, and one or more block layers each having block information with respect 
to one of the blocks, the coded signal merging apparatus comprising: first receiving 
means for receiving a base coded moving picture sequence signal, the base coded 
moving picture sequence signal being any one of the first coded moving picture 

30 sequence signal, the second coded moving picture sequence signal, and the differential 
coded moving picture sequence signal; merging storage means for storing the base 
coded moving picture sequence signal received by the first receiving means; request 
signal determining means for determining a request signal for a requested coded moving 
picture sequence signal on the basis of the base coded moving picture sequence signal 

35 stored by the merging storage means; request signal transmission means for transmitting 
the request signal for the requested coded moving picture sequence signal determined 
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by the request signal determining means; second receiving means for receiving the 
requested coded moving picture sequence signal; merging coded signal extracting 
means for extracting the base coded moving picture sequence signal from the merging 
storage means; merging means for merging the base coded moving picture sequence 
5 signal extracted by the merging coded signal extracting means with the requested coded 
moving picture sequence signal received by the second receiving means to reconstruct 
the first coded moving picture sequence signal on the basis of the second coefficient 
information obtained from the series of second picture information of the second coded 
moving picture sequence signal, and the differential coefficient information obtained 
10 from the differential coded signal; and outputting means for inputting the reconstructed 
first coded moving picture sequence signal from the merging means to be outputted 
therethrough. 

In the aforesaid coded signal merging apparatus, the first receiving means is 
operative to receive the second coded moving picture sequence signal, the merging 

15 storage means is operative to store the second coded moving picture sequence signal 
received by the first receiving means, the request signal determining means is operative 
to determine a request signal for a requested differential coded moving picture sequence 
signal on the basis of the second coded moving picture sequence signal stored by the 
merging storage means, the request signal transmission means is operative to transmit a 

20 request signal for the requested differential coded moving picture sequence signal 
determined by the request signal determining means, the second receiving means is 
operative to receive the requested differential coded moving picture sequence signal, the 
merging coded signal extracting means is operative to extract the second coded moving 
picture sequence signal from the merging storage means, and the merging means is 

25 operative to merge the second coded moving picture sequence signal extracted by the 
merging coded signal extracting means with the requested differential coded moving 
picture sequence signal received by the second receiving means to reconstruct the first 
coded moving picture sequence signal. 

The aforesaid coded signal merging apparatus may further comprise second 

30 coded moving picture sequence signal decoding means for decoding the second coded 
moving picture sequence signal received by the first receiving means. 

The aforesaid coded signal merging apparatus may further comprise editing 
means for cutting and combining component parts of the second coded moving picture 
sequence signal stored by the merging storage means to generate an edited second 

35 coded moving picture sequence signal in a desired size, in which the request signal 
detennining means is operative to determine a request signal for a requested differential 
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coded moving picture sequence signal on the basis of the edited second coded moving 
picture sequence signal generated by the editing means, the request signal transmission 
means is operative to transmit the request signal for the requested differential coded 
moving picture sequence signal determined by the request signal determining means, 
5 and the merging means is operative to merge the edited second coded moving picture 
sequence signal generated by the editing means with the requested differential coded 
moving picture sequence signal received by the second receiving means to reconstruct 
the first coded moving picture sequence signal in the desired size. 

m the aforesaid coded signal merging apparatus, the first receiving means is 

10 operative to receive the differential coded moving picture sequence signal, the merging 
storage means is operative to store the differential coded moving picture sequence 
signal received by the first receiving means, the request signal determining means is 
operative to determine a request signal for a requested second coded moving picture 
sequence signal on the basis of the differential coded moving picture sequence signal 

15 stored by the merging storage means, the request signal transmission means is operative 
to transmit the request signal for the requested second coded moving picture sequence 
signal determined by the request signal determining means, the second receiving means 
is operative to receive the requested second coded moving picture sequence signal, the 
merging coded signal extracting means is operative to extract the differential coded 

20 moving picture sequence signal stored by the merging storage means, and the merging 
means is operative to merge the differential coded moving picture sequence signal 
extracted by the merging coded signal extracting means with the second coded moving 
picture sequence signal received by the second receiving means to reconstruct the first 
coded moving picture sequence signal. 

25 In the aforesaid coded signal merging apparatus, the first receiving means is 

operative to receive the differential coded moving picture sequence signal by way of 
broadcasting. 

The aforesaid coded signal merging apparatus may further comprise 
reconstructed first coded signal storage means for storing the reconstructed first coded 
30 moving picture sequence signal reconstructed by the merging means. 

The aforesaid coded signal merging apparatus may further comprise: decoding 
means for decoding the first coded moving picture sequence signal or the second coded 
moving picture sequence signal; and merging coded signal converting means for 
inputting the first coded moving picture sequence signal to generate the second coded 
35 moving picture sequence signal, in which the first receiving means is operative to 
receive the first coded moving picture sequence signal, the decoding means is operative 
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to decode the first coded moving picture sequence signal received by the first receiving 
means, the merging coded signal converting means is operative to input the first coded 
moving picture sequence signal received by the first receiving means to generate the 
second coded moving picture sequence signal, the merging storage means is operative 
5 to store the second coded moving picture sequence signal generated by the merging 
coded signal converting means, the request signal determining means is operative to 
determine a request signal for a requested differential coded moving picture sequence 
signal on the basis of the second coded moving picture sequence signal stored by the 
merging storage means, the request signal transmission means is operative to transmit 
10 the request signal for the requested differential coded moving picture sequence signal 
determined by the request signal determining means, the second receiving means is 
operative to receive the requested differential coded moving picture sequence signal, the 
merging coded signal extracting means is operative to extract the second coded moving 
picture sequence signal from the merging storage means, and the merging means is 

15 operative to merge the second coded moving picture sequence signal extracted by the 
merging coded signal extracting means with the requested differential coded moving 
picture sequence signal received by the second receiving means to reconstruct the first 
coded moving picture sequence signal in the desired size. 

The aforesaid coded signal merging apparatus may further comprise: decoding 

20 means for decoding the first coded moving picture sequence signal or the second coded 
moving picture sequence signal; and merging differential coded signal generating means 
for inputting the first coded moving picture sequence signal to generate the differential 
coded moving picture sequence signal, the first receiving means is operative to receive 
the first coded moving picture sequence signal, the decoding means is operative to 

25 decode the first coded moving picture sequence signal received by the first receiving 
means, the merging differential coded signal generating means is operative to input the 
first coded moving picture sequence signal received by the first receiving means to 
generate the differential coded moving picture sequence signal, the merging storage 
means is operative to store the differential coded moving picture sequence signal 

30 generated by the merging coded signal converting means, the request signal determining 
means is operative to determine a request signal for a requested second coded moving 
picture sequence signal on the basis of the differential coded moving picture sequence 
signal stored by the merging storage means, the request signal transmission means is 
operative to transmit the request signal for the requested second coded moving picture 

35 sequence signal determined by the request signal determining means, the second 
receiving means is operative to receive the requested second coded moving picture 
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sequence signal, the merging coded signal extracting means is operative to extract the 
differential coded moving picture sequence signal from the merging storage means, and 
the merging means is operative to merge the differential coded moving picture sequence 
signal extracted by the merging coded signal extracting means with the requested 
second coded moving picture sequence signal received by the second receiving means 
to reconstruct the first coded moving picture sequence signal in the desired size. 

In accordance with a fourth aspect of the present invention, there is provided a 
multi-output coded signal separating apparatus for inputting a first coded moving 
picture sequence signal to separate into a plurality of second coded moving picture 
sequence signals and a plurality of differential coded moving picture sequence signals 
comprising: a plurality of coded signal separating units including a 1st coded signal 
separating unit up to a m-th coded signal separating unit wherein m is an integer not 
less than two; the 1st coded signal separating unit being operative to input the first 
coded moving picture sequence signal to separate into a 1st second coded moving 
picture sequence signal and a 1st differential coded moving picture sequence signal, the 
1st differential coded moving picture sequence signal being a difference between the 
first coded moving picture sequence signal and the 1st second coded moving picture 
sequence signal, and the i-th coded signal separating unit being operative to input an 
(i-l)-th second coded moving picture sequence signal to separate into an i-th second 
coded moving picture sequence signal and an i-th differential coded moving picture 
sequence signal, the i-th differential coded moving picture sequence signal being a 
difference between the (i-l)-th second coded moving picture sequence signal and the 
i-th second coded moving picture sequence signal wherein i is an integer equal to or less 
than m. 

The aforesaid 1st coded signal separating unit includes: 1st inputting means for 
inputting the first coded moving picture sequence signal therethrough, the first coded 
moving picture sequence signal generated as a result of encoding original moving 
picture sequence signal and consisting of a series of first picture information having first 
coefficient information, the first coefficient information including a matrix of first 
coefficients; 1st coded signal converting means for converting the first coded moving 
picture sequence signal inputted through the 1st inputting means to generate a 1st 
second coded moving picture sequence signal, the 1st second coded moving picture 
sequence signal consisting of a series of 1st second picture information having 1st 
second coefficient information, the 1st second coefficient information including a 
matrix of 1st second coefficients, each of the first coded moving picture sequence signal, 
and the 1st second coded moving picture sequence signal is in the form of a hierarchical 
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structure including one or more sequence layers each having a plurality of screens 
sharing common information, one or more picture layers each having a plurality of 
slices sharing common information with respect to one of the screens, one or more slice 
layers each having a plurality of macroblocks with respect to one of the slices, one or 
5 more macroblock layers each having a plurality of blocks with respect to one of the 
macroblocks, and one or more block layers each having block information with respect 
to one of the blocks; 1st differential coded signal generating means for inputting the first 
coded moving picture sequence signal and the 1st second coded moving picture 
sequence signal from the 1st coded signal converting means to generate a 1st 
10 differential coded moving picture sequence signal on the basis of the first coefficient 
information obtained from the series of first picture information of the first coded 
moving picture sequence signal, and the 1st second coefficient information obtained 
from the series of the 1st second picture information of the 1st second coded moving 
picture sequence signal, the 1st differential coded moving picture sequence signal being 

15 a difference between the first coded moving picture sequence signal and the 1st second 
coded moving picture sequence signal; 1st separating storage means for selectively 
storing the first coded moving picture sequence signal, the 1st second coded moving 
picture sequence signal, and the 1st differential coded moving picture sequence signal; 
1st first transmission means for selectively transmitting the first coded moving picture 

20 sequence signal, the 1st second coded moving picture sequence signal, and the 1st 
differential coded moving picture sequence signal; 1st request signal receiving means 
for receiving a request signal indicative of a requested coded moving picture sequence 
signal to be transmitted, the request signal indicative of the requested coded moving 
picture sequence signal being determined on the basis of the first coded moving picture 

25 sequence signal, the 1st second coded moving picture sequence signal, or the 1st 
differential coded moving picture sequence signal; 1st separating coded signal 
extracting means for extracting the requested coded moving picture sequence signal 
from the 1st separating storage means in response to the request signal; and 1st second 
transmission means for transmitting the requested coded moving picture sequence 

30 signal extracted by the 1 st separating coded signal extracting means. 

The aforesaid i-th coded signal separating unit includes: i-th inputting means 
for inputting the (i-l)-th second coded moving picture sequence signal therethrough 
from the (i-l)-th coded signal separating unit, the (i-l)-th second coded moving picture 
sequence signal generated as a result of encoding original moving picture sequence 

35 signal and consisting of a series of (i-l)-th second picture information having (i-l)-th 
second coefficient information, the (i-l)-th second coefficient information including a 
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matrix of (i-l)-th second coefficients; i-th coded signal converting means for converting 
the (i-l)-th second coded moving picture sequence signal inputted through the i-th 
inputting means to generate the i-th second coded moving picture sequence signal, the 
i-th second coded moving picture sequence signal consisting of a series of i-th second 
picture information having i-th second coefficient information, the i-th second 
coefficient information including a matrix of i-th second coefficients, each of the 
(i-l)-th second coded moving picture sequence signal, and the i-th second coded 
moving picture sequence signal is in the form of a hierarchical structure including one 
or more sequence layers each having a plurality of screens sharing common information, 
one or more picture layers each having a plurality of slices sharing common information 
with respect to one of the screens, one or more slice layers each having a plurality of 
macroblocks with respect to one of the slices, one or more macroblock layers each 
having a plurality of blocks with respect to one of the macroblocks, and one or more 
block layers each having block information with respect to one of the blocks; i-th 
differential coded signal generating means for inputting the (i-l)-th second coded 
moving picture sequence signal and the i-th second coded moving picture sequence 
signal from the i-th coded signal converting means to generate an i-th differential coded 
moving picture sequence signal on the basis of the (i-l)-th second coefficient 
information obtained from the series of (i-l)-th second picture information of the 
(i-l)-th second coded moving picture sequence signal, and the i-th second coefficient 
information obtained from the series of the i-th second picture information of the i-th 
second coded moving picture sequence signal, the i-th differential coded moving picture 
sequence signal being a difference between the (i-l)-th second coded moving picture 
sequence signal and the i-th second coded moving picture sequence signal; i-th 
separating storage means for selectively storing the (i-l)-th second coded moving 
picture sequence signal, the i-th second coded moving picture sequence signal, and the 
i-th differential coded moving picture sequence signal; i-th first transmission means for 
selectively ti^smitting the (i-l)-th second coded moving picture sequence signal, the 
i-th second coded moving picture sequence signal, and the i-th differential coded 
moving picture sequence signal; i-th request signal receiving means for receiving a 
request signal indicative of a requested coded moving picture sequence signal to be 
transmitted, the request signal indicative of the requested coded moving picture 
sequence signal being detennined on the basis of the (i-l)-th second coded moving 
picture sequence signal, the i-th second coded moving picture sequence signal, or the 
i-th differential coded moving picture sequence signal; i-th separating coded signal 
extracting means for extracting the requested coded moving picture sequence signal 
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from the i-th separating storage means in response to the request signal; and i-th second 
transmission means for transmitting the requested coded moving picture sequence 
signal extracted by the i-th separating coded signal extracting means. 

In accordance with a fifth aspect of the present invention, there is provided a 
multi-input coded signal merging apparatus for inputting a plurality of second coded 
moving picture sequence signals and a plurality of differential coded moving picture 
sequence signals to reconstruct a first coded moving picture sequence signal 
comprising: a plurality of the coded signal merging units including a 1st coded signal 
merging unit up to a n-th coded signal merging unit wherein n is an integer not less than 
two, in which the i-th coded signal merging unit is operative to input an i-th second 
coded moving picture sequence signal and an i-th differential coded moving picture 
sequence signal to reconstruct an (i-l)-th second coded moving picture sequence signal 
wherein i is an integer equal to or less than n, the i-th second coded moving picture 
sequence signal generated as a result of transcoding the (i-l)-th second coded moving 
picture sequence signal and consisting of a series of i-th second picture information 
having i-th second coefficient information, the i-th second coefficient information 
including a matrix of i-th second coefficients, the (i-l)-th second coded moving picture 
sequence signal generated as a result of encoding original moving picture sequence 
signal and consisting of a series of (i-l)-th second picture information having (i-l)-th 
second coefficient information, the (i-l)-th second coefficient information including a 
matrix of (i-l)-th second coefficients, the i-th differential coded moving picture 
sequence signal being a difference between the i-th second coded moving picture 
sequence signal and the (i-l)-th second coded moving picture sequence signal, the i-th 
differential coded moving picture sequence signal including i-th differential coefficient 
information between the i-th second coefficient information and the (i-l)-th second 
coefficient information, each of the i-th second coded moving picture sequence signal, 
the (i-l)-th second coded moving picture sequence signal, and the i-th differential coded 
moving picture sequence signal is in the form of a hierarchical structure including one 
or more sequence layers each having a plurality of screens sharing common information, 
one or more picture layers each having a plurality of slices sharing common information 
with respect to one of the screens, one or more slice layers each having a plurality of 
macroblocks with respect to one of the slices, one or more macroblock layers each 
having a plurality of blocks with respect to one of the macroblocks, and one or more 
block layers each having block information with respect to one of the blocks, and the 
1st coded signal merging unit is operative to input the 1st second coded moving picture 
sequence signal and the 1st differential coded moving picture sequence signal to 
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reconstruct the first coded moving picture sequence signal. 

The aforesaid i-th coded signal merging unit includes: i-th first receiving means 
for receiving a base coded moving picture sequence signal, the base coded moving 
picture sequence signal being any one of the i-th second coded moving picture sequence 
signal, the (i-l)-th second coded moving picture sequence signal, and the i-th 
differential coded moving picture sequence signal; i-th merging storage means for 
storing the base coded moving picture sequence signal received by the i-th first 
receiving means; i-th request signal detenruning means for detennining a request signal 
for a requested coded moving picture sequence signal on the basis of the base coded 
moving picture sequence signal stored by the i-th merging storage means; i-th request 
signal transmission means for transmitting the request signal for the requested coded 
moving picture sequence signal determined by the i-th request signal detennining 
means; i-th second receiving means for receiving the requested coded moving picture 
sequence signal; i-th merging coded signal extracting means for extracting the base 
coded moving picture sequence signal from the i-th merging storage means; i-th 
merging means for merging the base coded moving picture sequence signal extracted by 
the i-th merging coded signal extracting means with the requested coded moving picture 
sequence signal received by the i-th second receiving means to reconstruct the (i-l)-th 
second coded moving picture sequence signal on the basis of the second coefficient 
information obtained from the series of second picture information of the i-th second 
coded moving picture sequence signal, and the i-th differential coefficient information 
obtained from the i-th differential bit stream; and i-th outputting means for inputting the 
reconstructed i-th second coded moving picture sequence signal from the i-th merging 
means to be outputted therethrough. 

The aforesaid 1st coded signal merging unit includes: 1st first receiving means 
for receiving a base coded moving picture sequence signal, the base coded moving 
picture sequence signal being any one of the first coded moving picture sequence signal, 
the 1st second coded moving picture sequence signal, and the 1st differential coded 
moving picture sequence signal; 1st merging storage means for storing the base coded 
moving picture sequence signal received by the 1st first receiving means; 1st request 
signal determining means for determining a request signal for a requested coded moving 
picture sequence signal on the basis of the base coded moving picture sequence signal 
stored by the 1st merging storage means; 1st request signal transmission means for 
transmitting the request signal for the requested coded moving picture sequence signal 
determined by the 1st request signal determining means; 1st second receiving means for 
receiving the requested coded moving picture sequence signal; 1st merging coded signal 
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extracting means for extracting the base coded moving picture sequence signal from the 
1st merging storage means; 1st merging means for merging the base coded moving 
picture sequence signal extracted by the 1st merging coded signal extracting means with 
the requested coded moving picture sequence signal received by the 1st second 
5 receiving means to reconstruct the first coded moving picture sequence signal on the 
basis of the 1st second coefficient information obtained from the series of second 
picture information of the 1st second coded moving picture sequence signal, and the 1st 
differential coefficient information obtained from the 1st differential coded signal; and 
1st outputting means for inputting the reconstructed first coded moving picture 
10 sequence signal from the 1 st merging means to be outputted therethrough. 

hi the above mentioned the i-th coded signal separating unit, the i-th separating 
storage means is operative to store the (i-l)-th differential coded moving picture 
sequence signal generated by the i-th differential coded signal generating means, the i-th 
first transmission means is operative to transmit the (i-l)-th second coded moving 

15 picture sequence signal generated by the i-th coded signal converting means, the i-th 
request signal receiving means is operative to receive the request signal indicative of a 
requested (i-l)-th differential coded moving picture sequence signal to be transmitted, 
the request signal indicative of the requested (i-l)-th differential coded moving picture 
sequence signal being determined on the basis of the (i-l)-th second coded moving 

20 picture sequence signal, the i-th separating coded signal extracting means is operative to 
extract the requested (i-l)-th differential coded moving picture sequence signal from the 
i-th separating storage means in response to the request signal, and the i-th second 
transmission means is operative to transmit the requested (i-l)-th differential coded 
moving picture sequence signal extracted by the i-th separating coded signal extracting 

25 means, and the aforesaid multi-output coded signal separating apparatus is operative to 
input a first coded moving picture sequence signal to separate into a plurality of second 
coded moving picture sequence signals and a plurality of differential coded moving 
picture sequence signals. 

In the above described the i-th coded signal separating unit, the i-th first 

30 receiving means is operative to receive the i-th second coded moving picture sequence 
signal, the i-th merging storage means is operative to store the i-th second coded 
moving picture sequence signal received by the i-th first receiving means, the i-th 
request signal determining means is operative to determine a request signal for a 
requested differential coded moving picture sequence signal on the basis of the i-th 

35 second coded moving picture sequence signal stored by the i-th merging storage means, 
the i-fh request signal transmission means is operative to transmit the request signal for 
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the requested differential coded moving picture sequence signal determined by the i-th 
request signal determining means, the i-th second receiving means is operative to 
receive the requested differential coded moving picture sequence signal, the i-th 
merging coded signal extracting means is operative to extract the i-th second coded 
5 moving picture sequence signal from the i-th merging storage means, and the i-th 
merging means is operative to merge the i-th second coded moving picture sequence 
signal extracted by the i-th merging coded signal extracting means with the requested 
differential coded moving picture sequence signal received by the i-th second receiving 
means to reconstruct the (i-l)-th second coded moving picture sequence signal wherein 
10 the 0-th second coded moving picture sequence signal is the first coded moving picture 
sequence signal. 

In accordance with a sixth aspect of the present invention, there is provided a 
coded signal separating and merging system comprising: a multi-output coded signal 
separating apparatus for inputting a first coded moving picture sequence signal to 

15 separate into a plurality of second coded moving picture sequence signals and a 
plurality of differential coded moving picture sequence signals; and a multi-input coded 
signal merging apparatus for inputting a plurality of second coded moving picture 
sequence signals and a plurality of differential coded moving picture sequence signals to 
reconstruct the first coded moving picture sequence signal. The above multi-output 

20 coded signal separating apparatus includes: a plurality of coded signal separating units 
including a 1st coded signal separating unit up to a m-th coded signal separating unit 
wherein m is an integer not less than two. The above multi-input coded signal 
merging apparatus includes: a plurality of coded signal merging units including a 1st 
coded signal merging unit up to a n-th coded signal merging unit wherein n is an integer 

25 not less than two and equal to or less than the m. 

The above i-th coded signal separating unit includes: i-th inputting means for 
inputting an (i-l)-th second coded moving picture sequence signal therethrough from 
the (i-l)-th coded signal separating unit, the (i-l)-th second coded moving picture 
sequence signal generated as a result of encoding original moving picture sequence 

30 signal and consisting of a series of (i-l)-th second picture information having (i-l)-th 
second coefficient information, the (i-l)-th second coefficient information including a 
matrix of (i-l)-th second coefficients wherein i is an integer equal to or less than m, and 
0-th second coded moving picture sequence signal is the first coded moving picture 
sequence signal; i-th coded signal converting means for converting the (i-l)-th second 

35 coded moving picture sequence signal inputted through the i-th inputting means to 
generate an i-th second coded moving picture sequence signal, the i-th second coded 
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moving picture sequence signal consisting of a series of i-th second picture information 
having i-th second coefficient information, the i-th second coefficient information 
including a matrix of second coefficients, each of the (i-l)-th second coded moving 
picture sequence signal, and the i-th second coded moving picture sequence signal is in 
5 the form of a hierarchical structure including one or more sequence layers each having a 
plurality of screens sharing common information, one or more picture layers each 
having a plurality of slices sharing common information with respect to one of the 
screens, one or more slice layers each having a plurality of macroblocks with respect to 
one of the slices, one or more macroblock layers each having a plurality of blocks with 

10 respect to one of the macroblocks, and one or more block layers each having block 
information with respect to one of the blocks; i-th differential coded signal generating 
means for inputting the (i-l)-th second coded moving picture sequence signal and the 
i-th second coded moving picture sequence signal from the i-th coded signal converting 
means to generate an i-th differential coded moving picture sequence signal on the basis 

15 of the (i-l)-th second coefficient information obtained from the series of (i-l)-th second 
picture information of the (i-l)-th second coded moving picture sequence signal, and the 
i-th second coefficient information obtained from the series of the i-th second picture 
information of the i-th second coded moving picture sequence signal, the i-th 
differential coded moving picture sequence signal being a difference between the 

20 (i-l)-th second coded moving picture sequence signal and the i-th second coded moving 
picture sequence signal; i-th separating storage means for selectively storing the (i-l)-th 
second coded moving picture sequence signal, the i-th second coded moving picture 
sequence signal, and the i-th differential coded moving picture sequence signal; and i-th 
first transmission means for selectively transmitting the (i-l)-th second coded moving 

25 picture sequence signal, the i-th second coded moving picture sequence signal, and the 
i-th differential coded moving picture sequence signal to the i-th coded signal merging 
unit. 

The above i-th coded signal merging unit includes: i-th first receiving means 
for receiving a base coded moving picture sequence signal from the i-th coded signal 

30 separating unit or the (i+l)-th coded signal merging unit 6200i+l, the base coded 
moving picture sequence signal being any one of the (i-l)-th second coded moving 
picture sequence signal, the i-th second coded moving picture sequence signal, and the 
i-th differential coded moving picture sequence signal; i-th merging storage means for 
storing the base coded moving picture sequence signal received by the i-th first 

35 receiving means; i-th request signal determining means for determining a request signal 
for a requested coded moving picture sequence signal on the basis of the base coded 
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moving picture sequence signal stored by the i-th merging storage means; and i-th 
request signal transmission means for transmitting the request signal for the requested 
coded moving picture sequence signal determined by the i-th request signal determining 
means to the i-th coded signal separating unit. 
5 The above i-th coded signal separating unit further includes: i-th request signal 

receiving means for receiving the request signal transmitted by the i-th request signal 
transmission means from the i-th coded signal merging unit; i-th separating coded signal 
extracting means for extracting the requested coded moving picture sequence signal 
from the i-th separating storage means in response to the request signal; and i-th second 

10 transmission means for transmitting the requested coded moving picture sequence 
signal extracted by the i-th separating coded signal extracting means to the i-th coded 
signal merging unit. The above i-th coded signal merging unit includes: i-th second 
receiving means for receiving the requested coded moving picture sequence signal 
transmitted by the i-th second transmission means from the i-th coded signal separating 

15 unit; i-th merging coded signal extracting means for extracting the base coded moving 
picture sequence signal from the i-th merging storage means; i-th merging means for 
merging the base coded moving picture sequence signal extracted by the i-th merging 
coded signal extracting means with the requested coded moving picture sequence signal 
received by the i-th second receiving means on the basis of the i-th second coefficient 

20 information obtained from the series of second picture information of the i-th second 
coded moving picture sequence signal, and the i-th differential coefficient information 
obtained from the differential coded signal to reconstruct the (i-l)-th second coded 
moving picture sequence signal; and i-th outputting means for inputting the 
reconstructed (i-l)-th second coded moving picture sequence signal from the i-th 

25 merging means to be outputted therethrough. 

In the aforesaid coded signal separating and merging system, the i-th separating 
storage means of the i-th coded signal separating unit is operative to store the i-th 
differential coded moving picture sequence signal generated by the i-th differential 
coded signal generating means, the i-th first transmission means is operative to transmit 

30 the i-th second coded moving picture sequence signal generated by the i-th coded signal 
converting means, the i-th first receiving means of the i-th coded signal merging unit is 
operative to receive the i-th second coded moving picture sequence signal (i+l)-th 
coded signal merging unit, the i-th merging storage means is operative to store the i-th 
second coded moving picture sequence signal received by the i-th first receiving means, 

35 the i-th request signal determining means is operative to determine a request signal for a 
requested differential coded moving picture sequence signal on the basis of the i-th 
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second coded moving picture sequence signal stored by the i-th merging storage means, 
the i-th request signal transmission means is operative to transmit the request signal for 
the requested differential coded moving picture sequence signal determined by the i-th 
request signal determining means, the i-th request signal receiving means of the i-th 
5 coded signal separating unit is operative to receive the request signal transmitted by the 
i-th request signal transmission means, the i-th separating coded signal extracting means 
is operative to extract the requested differential coded moving picture sequence signal 
from the i-th separating storage means in response to the request signal, the i-th second 
transmission means is operative to transmit the requested differential coded moving 

10 picture sequence signal extracted by the i-th separating coded signal extracting means to 
the i-th coded signal merging unit, the i-th second receiving means of the i-th coded 
signal merging unit is operative to receive the requested differential coded moving 
picture sequence signal transmitted by the i-th second transmission means from the i-th 
coded signal separating unit, the i-th merging coded signal extracting means is operative 

15 to extract the i-th second coded moving picture sequence signal from the i-th merging 
storage means, and the i-th merging means is operative to merge the i-th second coded 
moving picture sequence signal extracted by the i-th merging coded signal extracting 
means with the requested differential coded moving picture sequence signal received by 
the i-th second receiving means to reconstruct the first coded moving picture sequence 

20 signal. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention and many of the advantages thereof will be better 
understood from the following detailed description when considered in connection with 
25 the accompanying drawings, wherein: 

FIG. 1 is a block diagram of a first preferred embodiment of a bit stream 
separating and merging system 1000 according to the present invention; 

FIG. 2 is a block diagram of a preferred embodiment of a bit stream separating 
apparatus 1 100 according to the present invention; 
30 FIG. 3 is a data structural diagram showing the hierarchical structure of a 

differential bit stream; 

FIG. 4 is a block diagram of a preferred embodiment of a bit stream merging 
apparatus 1200 according to the present invention; 

FIG. 5 is a diagram showing renderings of an environment in which a preferred 
35 embodiment of a bit stream separating and merging system 1000 according to the 
present invention is utilized; 
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FIG. 6 is a block diagram of a second preferred embodiment of a bit stream 
separating and merging system 2000 according to the present invention; 

FIG. 7 is a block diagram of a third preferred embodiment of a bit stream 
separating and merging system 3000 according to the present invention; 
5 FIG. 8 is a block diagram of a fourth preferred embodiment of a bit stream 

separating and merging system 4000 according to the present invention; 

FIG. 9 is a block diagram of a fifth preferred embodiment of a bit stream 
separating and merging system 5000 according to the present invention; 

FIG. 10 is a block diagram of a sixth preferred embodiment of a bit stream 
10 separating and merging system 6000 according to the present invention; 

FIG. 1 1 is a block diagram of a seventh preferred embodiment of a bit stream 
separating and merging system 7000 according to the present invention; 

FIG. 12 is a block diagram of a multi-output bit stream separating apparatus 
7100 according to the present invention; 
15 FIG. 13 is a block diagram of a multi-input bit stream merging apparatus 7200 

according to the present invention; 

FIG. 14 is a schematic block diagram showing a first conventional transcoder 

50; 

FIG. 15 is a flowchart showing the flow of the rate control operation of 
20 MPEG-2 performed by the first conventional transcoder 50 shown in FIG. 14; 

FIG. 16 is a schematic block diagram showing a second conventional 
transcoder 60; 

FIG. 17 is a flowchart showing the flow of the rate control operation of 
MPEG-2 performed by the second conventional transcoder 60 shown in FIG. 16; 
25 FIG. 18 is a schematic block diagram showing a third conventional transcoder 

80; 

FIG. 19 is a flowchart showing the flow of the rate control operation of 
MPEG-2 performed by the third conventional transcoder 80 shown in FIG. 18; 

FIG. 20 is a schematic block diagram showing a fourth conventional transcoder 

30 90. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Throughout the following detailed description, similar reference characters 
refer to similar elements in all figures of the drawings. 

I. First Embodiment of Bit Stream Separating and Merging System 1000 
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Referring to FIG. 1 of the drawings, there is shown a first preferred 
embodiment of a bit stream separating and merging system 1000 according to the 
present invention. 

The first preferred embodiment of the bit stream separating and merging 
5 system 1000 according to the present invention is shown in FIG. 1 as comprising a bit 
stream separating apparatus 1100 and a bit stream merging apparatus 1200. 

Some moving picture information is not required to have a high picture quality. 
Demo video moving picture information, for instance, is required to be promptly 
transmitted to audiences. Upon receiving the demo video moving picture information, 
10 the audiences can preview the demo video moving picture information as long as the 
demo video moving picture information has a minimum picture quality. 

In the first preferred embodiment of the bit stream separating and merging 
system 1000 according to the present invention, the bit stream separating apparatus 
1100 is operated to input an original MPEG-2 bit stream to separate into a transcoded 
15 MPEG-2 bit stream and a differential bit stream, and then store the differential bit 
stream in the bit stream separating apparatus 1100 and transmit only the transcoded 
MPEG-2 bit stream to the bit stream merging apparatus 1200. The bit rate of the 
transcoded MPEG-2 bit stream is lower than that of the original MPEG-2 bit stream, 
thereby making it possible for the bit stream separating apparatus 1100 to transmit the 
20 transcoded MPEG-2 bit stream to the bit stream merging apparatus 1200 faster than the 
original MPEG-2 bit stream. 

The bit stream merging apparatus 1200, on the other hand, can receive the 
transcoded MPEG-2 bit stream to reproduce moving picture information of a low 
picture quality, for instance, to be used as demo video moving picture information. If a 
25 user decides to watch the moving picture information of a high quality, the bit stream 
merging apparatus 1200 can transmit a request signal for a differential bit stream 
corresponding to the transcoded MPEG-2 bit stream already received to the bit stream 
separating apparatus 2100. In response to the request for the requested differential bit 
stream, the bit stream separating apparatus 1100 is operated to extract the requested 
30 differential bit stream from among the stored bit streams, and transmit the requested 
differential bit stream to the bit stream merging apparatus 1200. 

Upon receiving the requested differential bit stream, the bit stream merging 
apparatus 1200 is operated to merge the transcoded MPEG-2 bit stream already received 
and the requested differential bit stream just received to reconstruct the original 
35 MPEG-2 bit stream. 

This means that a user may receive the transcoded MPEG-2 bit stream at a bit 
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rate lower than that of the original MPEG-2 bit stream to reproduce low-quality moving 
picture information to be previewed, and later receive the differential bit stream to be 
merged with the transcoded MPEG-2 bit stream earlier received to reproduce 
high-quality moving picture information to be watched. 
5 Once the transcoded MPEG-2 bit stream has already been arrived, the bit 

stream separating apparatus 1100 is not required to retransmit the original MPEG-2 bit 
stream but the differential bit stream alone, thereby effectively utilize the transcoded 
MPEG-2 bit streams and the transmitting paths. 

The constructions of the bit stream separating apparatus 1100 and the bit 
10 stream merging apparatus 1200 will be described in detail before describing the 
operation of the bit stream separating and merging system 1000. 

I-A Bit Stream Separating apparatus 1100 

Referring to FIG. 2 of the drawings, there is shown a preferred embodiment of 

15 a bit stream separating apparatus 1100. As shown in FIG. 2, the bit stream 
separating apparatus 1100 comprises an inputting terminal al, bit stream converting 
means 111, differential bit stream generating means 112, separating storage means 120, 
first transmission means 141, request signal receiving means 142, bit stream extracting 
means 130, second transmission means 143, and outputting interfaces OUT1, OUT2. 

20 The bit stream converting means 111, differential bit stream generating means 112 
collectively constitute a separating means 110 for inputting an original MPEG-2 bit 
stream to separate into a transcoded MPEG-2 bit stream and a differential bit stream. 
The first transmission means 141, the request signal receiving means 142, and the 
second transmission means 143 collectively constitute a communication means 140 for 

25 transmitting and receiving bit streams and signals. The bit stream separating apparatus 
1100 constitutes the coded signal separating apparatus according to the present 
invention. The inputting terminal al, the bit stream converting means 111, the 
differential bit stream generating means 112, the bit stream extracting means 130 
respectively constitute inputting means, coded signal converting means, differential 

30 coded signal generating means, and separating coded signal extracting means according 
to the present invention. 

The inputting terminal al is adapted to input an original MPEG-2 bit stream 
therethrough. The original MPEG-2 bit stream is generated as a result of encoding 
original moving picture sequence signal and consisting of a series of first picture 

35 information having first coefficient information. The first coefficient information 
includes a matrix of first coefficients. 
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The bit stream converting means 111 is adapted to input the original MPEG-2 
bit stream through the inputting terminal al and convert the original MPEG-2 bit stream 
inputted through the inputting terminal al to generate a transcoded MPEG-2 bit stream. 
The bit stream converting means 111 can output the transcoded MPEG-2 bit stream thus 
generated to the differential bit stream generating means 112 and the separating storage 
means 120 through an interface outl. 

In the bit stream separating apparatus 1100 according to the present invention, 
the bit stream converting means 111 may directly transmit the transcoded MPEG-2 bit 
stream to the first transmission means 141 through an interface outl. Furthermore, the 
bit stream converting means 111 may output the original MPEG-2 bit stream inputted 
through the inputting means al to the differential bit stream generating means 112. 

The transcoded MPEG-2 bit stream consists of a series of second picture 
information having second coefficient information. The second coefficient 
information includes a matrix of second coefficients. Each of the original MPEG-2 bit 
stream, and the transcoded MPEG-2 bit stream is in the form of a hierarchical structure 
including one or more sequence layers each having a plurality of screens sharing 
common information, one or more picture layers each having a plurality of slices 
sharing common information with respect to one of the screens, one or more slice layers 
each having a plurality of macroblocks with respect to one of the slices, one or more 
macroblock layers each having a plurality of blocks with respect to one of the 
macroblocks, and one or more block layers each having block information with respect 
to one of the blocks. 

The differential bit stream generating means 112 is adapted to input the original 
MPEG-2 bit stream and the transcoded MPEG-2 bit stream from the bit stream 
converting means 111 to generate a differential bit stream on the basis of the first 
coefficient information obtained from the series of first picture information of the 
original MPEG-2 bit stream, and the second coefficient information obtained from the 
series of the second picture information of the transcoded MPEG-2 bit stream. The 
differential bit stream generating means 112 is adapted to output the differential bit 
stream thus generated to the separating storage means 120 through an interface out2. 
Here, the differential bit stream is intended to mean a difference between the original 
MPEG-2 bit stream and the transcoded MPEG-2 bit stream. 

More specifically, the differential bit stream, thus generated by the differential 
bit stream generating means 112, is in the form of the hierarchical structure including 
the sequence layers, the picture layers, the slice layers, the macroblock layers, and the 
block layers, similar to the original MPEG-2 bit streams and the transcoded MPEG-2 bit 



46 



streams as shown in FIG. 3. The differential bit stream starts from a sequence header 
of the sequence layer. Followed by the sequence header, picture layer data elements 
continue for the number of pictures contained in the sequence layer. The picture layer 
data element comprises a picture header and picture data elements. The picture data 
element includes a plurality of slice layer data elements. The slice layer data element 
comprises a slice header and a plurality of MB layer data elements. The MB layer data 
element comprises MB attribute information and block layer data elements. Block 
layer data element contains coefficient information. The coefficient information 
includes a matrix of coefficients. 

The separating storage means 120 is adapted to selectively input and store the 
transcoded MPEG-2 bit stream through the interface outl, and the differential bit 
stream through the interface out2. In the bit stream separating apparatus 1100, the 
separating storage means 120 may input and store the original MPEG-2 bit stream 
through the inputting means al. 

The first transmission means 141 is adapted to selectively transmit a base bit 
stream, which will be described later, to a bit stream merging apparatus 1200 through 
the outputting interface OUTl. 

The request signal receiving means 142 is adapted to receive a request signal 
indicative of a requested bit stream, which will be described later. 

The second transmission means 143 is adapted to transmit the requested bit 
stream, which will be described later, through the outputting interface OUT2. 

The bit stream extracting means 130 is adapted to extract the requested bit 
stream from among bit streams stored in the separating storage means 120 in response 
to the request signal. 

The bit stream separating apparatus 1100 thus constructed is adapted to input 
an original MPEG-2 bit stream through the inputting terminal al to separate into and 
output a transcoded MPEG-2 bit stream and a differential bit stream through the 
outputting interfaces OUTl and OUT2. 

I-B Bit Stream Merging Apparatus 1200 

Referring then to FIG. 4 of the drawings, there is shown a preferred 
embodiment of a bit stream merging apparatus 1200. As shown in FIG. 4, the bit 
stream merging apparatus 1200 comprises inputting interfaces TNI, IN2, first receiving 
means 211, merging storage means 220, request signal determining means 230, request 
signal transmission means 213, second receiving means 212, merging bit stream 
extracting means 241, merging means 242, and an outputting terminal bl. The first 
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receiving means 211, the second receiving means 212, and the request signal 
transmission means 213 collectively constitute the communication means 210. The 
merging bit stream extracting means 241 and the merging means 242 collectively 
constitute the merging means 240. The bit stream merging apparatus 1200 constitutes 
the coded signal merging apparatus according to the present invention. The merging 
bit stream extracting means 241 constitutes merging coded signal extracting means 
according to the present invention. 

The first receiving means 211 is adapted to receive the base bit stream 
transmitted by the first transmission means 141 of the bit stream separating apparatus 
1100 through the inputting interface INI. Here, the base bit stream is intended to 
mean any one of the original MPEG-2 bit stream, the transcoded MPEG-2 bit stream, 
and the differential bit stream transmitted by the first transmission means 141 . 

The merging storage means 220 is adapted to input and store the base bit 
stream received by the first receiving means 211. 

The request signal detemiining means 230 is adapted to determine a request 
signal for a requested bit stream on the basis of the base bit stream stored by the 
merging storage means 220. More specifically, the request signal determining means 
230 is adapted to determine a requested bit stream, which is to be merged with the base 
bit stream to reconstruct the original MPEG-2 bit stream, on the basis of the base bit 
stream stored by the merging storage means 220 and then determine a request signal. 

The request signal transmission means 213 is adapted to transmit the request 
signal for the requested bit stream determined by the request signal determining means 
230 to the bit stream separating apparatus 1100. 

The second receiving means 212 is adapted to receive the requested bit stream 
transmitted by the second transmission means 143 of the bit stream separating apparatus 
1100 through the inputting interface IN2. 

The merging bit stream extracting means 241 is adapted to extract the base bit 
stream from among bit streams stored in the merging storage means 220. 

The merging means 242 is adapted to merge the base bit stream extracted by 
the merging bit stream extracting means 241 with the requested bit stream received by 
the second receiving means 212 on the basis of the second coefficient information 
obtained from the series of second picture information of the transcoded MPEG-2 bit 
stream, and the differential coefficient information obtained from the differential bit 
stream to reconstruct the original MPEG-2 bit stream. 

The outputting terminal bl is adapted to input the reconstructed original 
MPEG-2 bit stream from the merging means 242 to be outputted therethrough. 
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The bit stream merging apparatus 1200 thus constructed can input a transcoded 
MPEG-2 bit stream and a differential bit stream through the inputting interfaces INI 
and IN2 to reconstruct and output the original MPEG-2 bit stream through the 
outputting terminal bl. 

5 Renderings of an environment in which a preferred embodiment of bit stream 

separating and merging system 1000 comprising the bit stream separating apparatus 
1 100 and the bit stream merging apparatus 1200 is utilized are shown in FIG. 5. 

As best shown in FIG. 5, there are provided the bit stream separating apparatus 
1100 according to the present invention, the bit stream merging apparatus 1200 

10 according to the present invention, an encoder 60, and transmitting paths. 

The encoder 60 is adapted to input original moving picture sequence 
information, i.e., high-quality moving picture sequence information to output 
high-quality MPEG-2 bit streams, i.e., original MPEG-2 bit streams. The bit stream 
separating apparatus 1100 is adapted to input the original MPEG-2 bit streams from the 

15 encoder 60, and transcode and separate the original MPEG-2 bit streams to generate 
transcoded MPEG-2 bit streams and differential bit streams. The differential bit 
streams are differences between the original MPEG-2 bit streams and the transcoded 
MPEG-2 bit streams. The transcoded MPEG-2 bit streams and differential bit streams 
thus generated are transmitted through the transmitting paths to users. 

20 A user may operate a conventional decoder, not shown, to decode the 

transcoded MPEG-2 bit streams to reproduce low-quality moving picture sequence 
information as shown in FIG. 5. 

A user, on the other hand, can operate the bit stream merging apparatus 1200 
according to present invention to merge the transcoded MPEG-2 bit streams and the 

25 differential bit streams to reconstruct the original MPEG-2 bit streams, i.e., high-quality 
MPEG-2 bit streams, thereby enabling to reproduce the original, high-quality moving 
picture sequence information. The differential bit streams may be transmitted 
simultaneously with the transcoded MPEG-2 bit streams or may be transmitted after the 
transcoded MPEG-2 bit streams are transmitted. 

30 Conventionally, it is required to transmit the original MPEG-2 bit streams in 

addition to the transcoded MPEG-2 bit stream through the transmitting path for 
reproducing the original, high-quality moving picture sequence information. 

The bit stream separating apparatus 1100 according to the present invention, on 
the other hand, enables to transcode and separate the original MPEG-2 bit stream to 

35 generate the differential bit stream in addition to the transcoded MPEG-2 bit stream. 
The bit stream merging apparatus 1200 according to the present invention enables to 
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reproduce the original, high-quality moving picture sequence information from the 
transcoded MPEG-2 bit stream and the differential bit stream. 

The bit stream merging apparatus 1200 makes it possible to reconstruct the 
original MPEG-2 bit stream to reproduce the high-quality moving picture sequence 
5 information, for instance, from the transcoded MPEG-2 bit stream earlier received and 
stored and the differential bit stream later received, thereby eliminating the time and 
effort to transmit the original MPEG-2 bit stream in addition to the transcoded MPEG-2 
bit stream through the transmitting path. This leads to the fact that the bit stream 
separating apparatus 1100 and the bit stream merging apparatus 1200 according to the 

10 present invention make it possible to effectively utilize the transcoded MPEG-2 bit 
streams and the transmitting paths. 

Alternatively, the bit stream merging apparatus 1200 may further comprises 
original bit stream storage means, not shown, which is adapted to input and store the 
reconstructed original MPEG-2 bit stream reconstructed by the merging means 242. 

15 The original bit stream storage means of the bit stream merging apparatus 1200 
according to the present invention enables a user to store the reconstructed original 
MPEG-2 bit stream, thereby eliminating the time and effort to send the original 
MPEG-2 bit stream or resend the transcoded MPEG-2 bit stream or the differential bit 
stream. The original bit stream storage means constitute the reconstructed first coded 

20 signal storage means according to the present invention. 

I-C Operation of Bit Stream Separating and Merging System 1000 

Referring to FIG. 1 of the drawings, there is shown a first preferred 
embodiment of a bit stream separating and merging system 1000 according to the 
25 present invention. 

The first preferred embodiment of the bit stream separating and merging 
system 1000 according to the present invention is shown in FIG. 1 as comprising a bit 
stream separating apparatus 1100 for inputting an original MPEG-2 bit stream to 
separate into a transcoded MPEG-2 bit stream and a differential bit stream, and a bit 
30 stream merging apparatus 1200 for inputting the transcoded MPEG-2 bit stream and the 
differential bit stream. 

The constructions of the bit stream separating apparatus 1100 and the bit 
stream merging apparatus 2100 have already been mentioned. 

The operation of the bit stream separating and merging system 1000 will be 
35 described hereinlater in reference to FIG. 1 , FIG.2, and FIG. 4. 

In the bit stream separating apparatus 1100, the inputting means al is operated 



50 



to input the original MPEG-2 bit stream therethrough. 

The bit stream converting means 111 of the separating means 110 is operated to 
convert the original MPEG-2 bit stream inputted through the inputting means al to 
generate the transcoded MPEG-2 bit stream. 
5 The differential bit stream generating means 112 is operated to input the 

original MPEG-2 bit stream and the transcoded MPEG-2 bit stream from the bit stream 
converting means 111 to generate a differential bit stream on the basis of the first 
coefficient information obtained from the series of first picture information of the 
original MPEG-2 bit stream, and the second coefficient information obtained from the 
10 series of the second picture information of the transcoded MPEG-2 bit stream. 

The separating storage means 120 is operated to selectively store the original 
MPEG-2 bit stream inputted through the inputting means al, the transcoded MPEG-2 
bit stream generated by the bit stream converting means 111, and the differential bit 
stream generated by differential bit stream generating means 110. 
15 The first transmission means 141 is operated to transmit a base bit stream to the 

bit stream merging apparatus 1200. Here, the base bit stream is intended to mean any 
one of the original MPEG-2 bit stream, the transcoded MPEG-2 bit stream, and the 
differential bit stream. 

In the bit stream merging apparatus 1200, the first receiving means 211 is 
20 operated to receive the base bit stream transmitted by the first transmission means 141 
of the bit stream separating apparatus 1100. 

The merging storage means 220 is operated to store the base bit stream 
received by the first receiving means 211. 

The request signal determining means 230 is operated to determine a request 
25 signal for a requested bit stream on the basis of the base bit stream stored by the 
merging storage means 220. 

The request signal transmission means 213 is operated to transmit the request 
signal for the requested bit stream determined by the request signal determining means 
230 to the bit stream separating apparatus 1 100. 
30 In the bit stream separating apparatus 1100, the request signal receiving means 

142 is operated to receive the request signal transmitted by the request signal 
transmission means 213 of the bit stream merging apparatus 1200. 

The separating bit stream extracting means 130 is operated to extract the 
requested bit stream from among bit streams stored in the separating storage means 120 
35 in response to the request signal. 

The second transmission means 143 is operated to transmit the requested bit 
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stream extracted by the separating bit stream extracting means 130 to the bit stream 
merging apparatus 1200. 

In the bit stream merging apparatus 1200, the second receiving means 212 is 
operated to receive the requested bit stream transmitted by the second transmission 
5 means 143 of the bit stream separating apparatus 1100. 

The merging bit stream extracting means 241 is operated to extract the base bit 
stream from among bit streams stored in the merging storage means 220. 

The merging means 242 is operated to merge the base bit stream extracted by 
the merging bit stream extracting means 241 with the requested bit stream received by 
10 the second receiving means 212 on the basis of the second coefficient information 
obtained from the series of second picture information of the transcoded MPEG-2 bit 
stream, and the differential coefficient information obtained from the differential bit 
stream to reconstruct the original MPEG-2 bit stream. 

The outputting means bl is operated to input the reconstructed original 
15 MPEG-2 bit stream from the merging means 242 to be outputted therethrough. 

The first embodiment of the bit stream separating and merging system 1000 
thus constructed makes it possible for a user to receive a transcoded MPEG-2 bit stream 
at a bit rate lower than that of an original MPEG-2 bit stream to decode, reproduce, and 
preview low-quality picture information, and later receive a differential bit stream to be 
20 merged with the transcoded MPEG-2 bit stream earlier received to reproduce 
high-quality picture information, thereby eliminating the time and effort to transmit the 
original MPEG-2 bit stream, and thus effectively utilize the transcoded MPEG-2 bit 
streams and the transmitting paths. 

Furthermore, in the bit stream separating and merging system 1000 according 
25 to the present invention, the bit stream separating apparatus 1 100 can firstly transmit the 
differential bit stream and later transmit the transcoded MPEG-2 bit stream, and the bit 
stream merging apparatus 1200 can firstly receive the differential bit stream and later 
receive the transcoded MPEG-2 bit stream. 

30 n. Second Embodiment of Bit Stream Separating and Merging System 2000 
Referring to FIG. 6 of the drawings, there is shown a second preferred 
embodiment of a bit stream separating and merging system 2000 according to the 
present invention. 

The second preferred embodiment of the bit stream separating and merging 
35 system 2000 according to the present invention is shown in FIG. 6 as comprising a bit 
stream separating apparatus 2100 for inputting an original MPEG-2 bit stream to 
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separate into a transcoded MPEG-2 bit stream and a differential bit stream, and a bit 
stream merging apparatus 2200 for inputting the transcoded MPEG-2 bit stream and the 
differential bit stream to reconstruct the original MPEG-2 bit stream. 

The bit stream separating apparatus 2100 and the bit stream merging apparatus 
2200 are similar in construction as the bit stream separating apparatus 1100 and the bit 
stream merging apparatus 1200 except for the fact that the bit stream separating 
apparatus 2100 is adapted to store the differential bit stream in the separating storage 
means 120 and transmit the transcoded MPEG-2 bit stream to the bit stream merging 
apparatus 2200, and the bit stream merging apparatus 2200 is adapted to firstly receive 
the transcoded MPEG-2 bit stream and later receive the differential bit stream. 

The operation of the bit stream separating and merging system 2000 will be 
described with reference to FIG. 6 hereinlater. The same constitutional elements are 
simply represented by the same reference numerals as those of the bit stream separating 
apparatus 1100 and the bit stream merging apparatus 1200, and will be thus omitted 
from description for avoiding tedious repetition. 

In the bit stream separating apparatus 2100, the inputting means al is operated 
to input an original MPEG-2 bit stream 11 therethrough to be outputted to the bit stream 
converting means 111. 

The bit stream converting means 111 is operated to convert the original 
MPEG-2 bit stream 11 inputted through the inputting means al to generate the 
transcoded MPEG-2 bit stream 12 to be outputted to the differential bit stream 
generating means 112 and the first transmission means 141 through the interface outl. 
The bit stream converting means 111 is also operated to output the original MPEG-2 bit 
stream 11 inputted through the inputting means al to the differential bit stream 
generating means 112. 

The differential bit stream generating means 112 is operated to input the 
original MPEG-2 bit stream 11 and the transcoded MPEG-2 bit stream 12 from the bit 
stream converting means 111 to generate a differential bit stream 13 to be outputted to 
the separating storage means 120 through the interface out2. 

The separating storage means 120 is operated to store the differential bit stream 
13 generated by the differential bit stream generating means 112. 

The first transmission means 141 is operated to transmit the transcoded 
MPEG-2 bit stream 12 generated by the bit stream converting means 111 to the bit 
stream merging apparatus 2200. 

In the bit stream merging apparatus 2200, the first receiving means 211 is 
operated to receive the transcoded MPEG-2 bit stream 12 transmitted by the first 
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transmission means 141. 

The merging storage means 220 is operated to store the transcoded MPEG-2 bit 
stream 12 received by the first receiving means 211. 

The request signal determining means 230 is operated to determine a request 
signal 15 for a requested differential bit stream 16 on the basis of the transcoded 
MPEG-2 bit stream 12 stored by the merging storage means 220. This means that the 
request signal detennining means 230 is operated determine a requested differential bit 
stream 16 and a request signal 15 for the requested differential bit stream 16 on the basis 
of the transcoded MPEG-2 bit stream 12 stored by the merging storage means 220. 

The request signal transmission means 213 is operated to transmit the request 
signal 15 for the requested differential bit stream 16 determined by the request signal 
determining means 230. 

In the bit stream separating apparatus 2100, the request signal receiving means 
142 is operated to receive the request signal 15 for the requested differential bit stream 
16 transmitted by the request signal transmission means 213 of the bit stream merging 
apparatus 2200. 

The bit stream extracting means 130 is operated to extract the requested 
differential bit stream 16 from among bit streams stored in the separating storage means 
120 in response to the request signal. 

The second transmission means 143 is operated to transmit the requested 
differential bit stream 16 extracted by the bit stream extracting means 130 from among 
bit streams stored in the separating storage means 120 to the bit stream merging 
apparatus 2200, 

In the bit stream merging apparatus 2200, the second receiving means 212 is 
operated to receive the requested differential bit stream 16 transmitted by the second 
transmission means 143 of the bit stream separating apparatus 2100. 

The merging bit stream extracting means 241 is operated to extract the 
transcoded MPEG-2 bit stream 14 from among bit streams stored in the merging storage 
means 220. 

The merging means 242 is operated to merge the transcoded MPEG-2 bit 
stream 14 extracted by the merging bit stream extracting means 241 with the requested 
differential bit stream 16 received by the second receiving means 212 to reconstruct the 
original MPEG-2 bit stream 17. 

The outputting means bl is operated to input the reconstructed original 
MPEG-2 bit stream 17 from the merging means 242 to be outputted therethrough. 

According to the present invention, the bit stream merging apparatus 2200 may 
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further comprise a decoding means 225 for decoding the transcoded MPEG-2 bit stream 
12 received by the first receiving means 211. 

The second embodiment of the bit stream separating and merging system 1000 
thus constructed makes it possible for a user to receive a transcoded MPEG-2 bit stream 
5 at a bit rate lower than that of an original MPEG-2 bit stream to decode, reproduce, and 
preview low-quality picture information, and later receive a differential bit stream to be 
merged with the transcoded MPEG-2 bit stream earlier received to reproduce 
high-quality picture information, thereby effectively utilize the transcoded MPEG-2 bit 
streams and the transmitting paths. 

10 The bit stream merging apparatus 2200 according to the present invention, may 

comprise original bit stream storage means, not shown, for inputting and storing the 
reconstructed original MPEG-2 bit stream 17 reconstructed by the merging means 242. 
Alternatively, the merging storage means 220 of the bit stream merging apparatus 2200 
according to the present invention may input and store the reconstructed original 

15 MPEG-2 bit stream reconstructed by the merging means 242. The bit stream merging 
apparatus 2200 thus constructed enables to store the reconstructed original MPEG-2 bit 
stream once reconstructed, thereby eliminating the time and effort to resend the 
transcoded MPEG-2 bit stream or the differential bit stream. The original bit stream 
storage means constitute the reconstructed first coded signal storage means according to 

20 the present invention. 

IH. Third embodiment of Bit Stream Separating and Merging System 3000 

Referring to FIG. 7 of the drawings, there is shown a third preferred 
embodiment of a bit stream separating and merging system 3000 according to the 
25 present invention. 

The third preferred embodiment of the bit stream separating and merging 
system 3000 according to the present invention is shown in FIG. 7 as comprising a bit 
stream separating apparatus 3100 and a bit stream merging apparatus 3200. The bit 
stream separating apparatus 3100 and the bit stream merging apparatus 3200 are similar 
30 in construction as the bit stream separating apparatus 2100 and the bit stream merging 
apparatus 2200 except for the fact that the bit stream merging apparatus 3200 further 
comprises editing means 235 in addition to the request signal determining means 230. 

The editing means 235 is adapted to cut and combine component parts of the 
transcoded MPEG-2 bit stream stored by the merging storage means 220 to generate an 
35 edited MPEG-2 bit stream in a desired size. 

Some moving picture information is required to be promptly transmitted but 
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not required to maintain a high picture quality. News moving picture information, for 
instance, is required to be instantaneously transmitted to editors. The editors, on the 
other hand, can review and edit the news moving picture information as long as the 
news moving picture information has a minimum picture quality. 

m the third preferred embodiment of the bit stream separating and merging 
system 3000 according to the present invention, the bit stream separating apparatus 
3100 is adapted to input an original MPEG-2 bit stream 31 to separate into a transcoded 
MPEG-2 bit stream 32 and a differential bit stream 33, and store the differential bit 
stream 33 in the separating storage means 120 and transmit the transcoded MPEG-2 bit 
stream 32 to the bit stream merging apparatus 3200. The bit rate of the transcoded 
MPEG-2 bit stream 32 is lower than that of the original MPEG-2 bit stream 31, thereby 
making it possible for the bit stream separating apparatus 3100 to transmit the 
transcoded MPEG-2 bit stream 32 to the bit stream merging apparatus 3200 faster than 
the original MPEG-2 bit stream 3 1 . 

The bit stream merging apparatus 3200, on the other hand, can edit the 
transcoded MPEG-2 bit stream 32 thus received to generate an edited transcoded 
MPEG-2 bit stream 32.5 in a desired size. The request signal determining means 230 
is adapted to determine a requested differential bit stream 36 to be merged with the 
edited transcoded MPEG-2 bit stream 32.5, and a request signal 35 for the requested 
differential bit stream 36 on the basis of the edited transcoded MPEG-2 bit stream 32.5, 
and then transmit the request signal 35 for the requested differential bit stream 36 to the 
bit stream separating apparatus 3100. 

In response to the request signal 35 for the requested differential bit stream 36, 
the bit stream separating apparatus 3100 is adapted to extract the requested differential 
bit stream 36 from among the stored differential bit stream, and transmit the requested 
differential bit stream 36 to the bit stream merging apparatus 3200. 

Upon receiving the requested differential bit stream 36, the bit stream merging 
apparatus 3200 is adapted to merge the edited transcoded MPEG-2 bit stream 32.5 and 
the requested differential bit stream 36 to reconstruct the original MPEG-2 bit stream 37 
in the desired size. 

The bit stream separating and merging system 3000 makes it possible for a user 
to firstly receive and edit the transcoded MPEG-2 bit stream 32 and then later receive 
the differential bit stream 36 corresponding to the edited MPEG-2 bit stream 32.5 to 
reconstruct the original MPEG-b bit stream 37 used to reproduce high-quality moving 
picture information in the edited size. 

The bit stream separating apparatus 3100 is not required to transmit all of the 
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differential bit stream but requested parts of the differential bit stream only, thereby 
reducing the volume of the differential bit stream to be transmitted. 

The operation of the bit stream separating and merging system 3000 will be 
described with reference to FIG. 7 hereinlater. The same operation as that of the bit 
5 stream separating and merging system 2000 will be omitted for avoiding tedious 
repetition. 

The editing means 235 is operated to cut and combine component parts of the 
transcoded MPEG-2 bit stream 32 stored by the merging storage means 220 to generate 
an edited transcoded MPEG-2 bit stream 32.5 in a desired size. 

10 The request signal determining means 230 is operated to determine a request 

signal 35 for a requested differential bit stream 36 on the basis of the edited transcoded 
MPEG-2 bit stream 32.5 generated by the editing means 235. This means that the 
request signal determining means 230 is operated to determine a requested differential 
bit stream 36 and a request signal 35 for the requested differential bit stream 36 on the 

15 basis of the edited transcoded MPEG-2 bit stream 32.5 generated by the editing means 
235. 

The request signal transmission means 213 is operated to transmit the request 
signal 35 for the requested differential bit stream 36 determined by the request signal 
determining means 230 to the bit stream separating apparatus 3100. 
20 In the bit stream separating apparatus 3 100, the separating bit stream extracting 

means 130 is operative to extract the requested differential bit stream 36 from among bit 
streams stored in the separating storage means 120 in response to the request signal 35. 

The merging bit stream extracting means 241 is operated to extract the edited 
transcoded MPEG-2 bit stream 34 from among bit streams stored in the merging storage 
25 means 220. 

The merging means 242 is operated to merge the edited transcoded MPEG-2 
bit stream 34 extracted by the bit stream extracting means 241 with the requested 
differential bit stream 36 received by the second receiving means 212 to reconstruct the 
original MPEG-2 bit stream 37 in the desired size. 

30 The third embodiment of the bit stream separating and merging system 3000 

thus constructed makes it possible for a user to firstly receive and edit a transcoded 
MPEG-2 bit stream and then later receive a differential bit stream corresponding to the 
MPEG-2 bit stream thus edited to reconstruct an original MPEG-2 bit stream and 
reproduce high-quality moving picture information in an edited size, thereby enabling to 

35 promptly edit the original MPEG-2 bit stream and reduce the volume of the differential 
bit stream to be transmitted. 
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IV. Fourth embodiment of Bit Stream Separating and Merging System 4000 

Referring to FIG. 8 of the drawings, there is shown a fourth preferred 
embodiment of a bit stream separating and merging system 4000 according to the 
5 present invention. 

The fourth preferred embodiment of the bit stream separating and merging 
system 4000 according to the present invention is shown in FIG. 8 as comprising a bit 
stream separating apparatus 4100 and a bit stream merging apparatus 4200. 

The bit stream separating apparatus 4100 and the bit stream merging apparatus 
10 4200 are similar in construction as the bit stream separating apparatus 1100 and the bit 
stream merging apparatus 1200 except for the fact that the bit stream separating 
apparatus 4100 is adapted to store the transcoded MPEG-2 bit stream in the separating 
storage means 120 and transmit the differential bit stream to the bit stream merging 
apparatus 2200, and the bit stream merging apparatus 4200 is adapted to firstly receive 
15 the differential MPEG-2 bit stream and later receive the transcoded MPEG-2 bit stream. 

In the second embodiment of the bit stream separating and merging system 
2000, the bit stream separating apparatus 2100 is adapted to firstly transmit the 
transcoded MPEG-2 bit streams to the bit stream merging apparatus 2200 and later 
transmit the differential bit streams to the bit stream merging apparatus 2200 in response 
20 to the request signal transmitted by the bit stream merging apparatus 2200. 

In the embodiment of the bit stream separating and merging system 4000 
according to the present invention, the bit stream separating apparatus 4100, on the 
other hand, is adapted to firstly transmit the differential bit streams to the bit stream 
merging apparatus 4200 and later transmit the transcoded MPEG-2 bit streams in 
25 response to the request signal transmitted by the bit stream merging apparatus 4200. 

A program provider, i.e., a broadcast station, for instance, can deliver 
differential bit streams to a plurality of subscribers in their homes. The differential bit 
streams delivered are automatically stored in home servers or local storages in 
respective homes. 

30 When a subscriber wants to watch a specific film program, the subscriber can 

transmit a request signal for a requested transcoded MPEG-2 bit stream to be merged 
with the differential bit stream earlier delivered containing the film program to be 
watched, to the broadcast station. In response to the request signal, the broadcast 
station can transmit the requested transcoded MPEG-2 bit stream to the subscriber and 

35 the subscriber can watch the program by merging the requested transcoded MPEG-2 bit 
stream just received and the differential bit stream already stored. The subscriber can 
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receive the transcoded MPEG-2 bit stream faster than the original MPEG-2 bit stream 
since the bit rate of the transcoded MPEG-2 bit stream is lower than that of the original 
MPEG-2 bit stream. This means that the bit stream separating and merging system 
4000 can promptly deliver the moving picture information to subscribers. 
5 Furthermore, the differential bit stream earlier delivered to subscribers cannot 

be decoded, thereby preventing the illegal copy of the moving picture information. 

The operation of the bit stream separating and merging system 4000 will be 
described with reference to FIG. 8 hereinlater. The same operation as that of the bit 
stream separating and merging system 1000 will be omitted. 
10 In the bit stream separating apparatus 4100, the inputting means al is operated 

to input an original MPEG-2 bit stream 41 therethrough to be outputted to the bit stream 
converting means 111. 

The bit stream converting means 111 is operated to convert the original 
MPEG-2 bit stream 41 inputted through the mputting means al to generate the 
15 transcoded MPEG-2 bit stream 43 to be outputted to the differential bit stream 
generating means 112 and the separating storage means 120 through the interface outl. 
The bit stream converting means 111 is also operated to output the original MPEG-2 bit 
stream 41 inputted through the inputting means al to the differential bit stream 
generating means 112. 

20 The differential bit stream generating means 112 is operated to input the 

original MPEG-2 bit stream 41 and the transcoded MPEG-2 bit stream 43 from the bit 
stream converting means 111 to generate a differential bit stream 42 to be outputted to 
the first transmission means 141 through the interface out2. 

The separating storage means 120 is operated to input and store the transcoded 
25 MPEG-2 bit stream 43 generated by the bit stream converting means 111. 

The first transmission means 141 is operated to input and transmit the 
differential bit stream 42 generated by the differential bit stream generating means 112 
to the bit stream merging apparatus 4200. 

hi the bit stream merging apparatus 4200, the first receiving means 211 is 
30 operated to receive the differential bit stream 42 transmitted by the first transmission 
means 141. 

The merging storage means 220 is operated to store the differential bit stream 
42 received by the first receiving means 211. 

The request signal determining means 230 is operated to determine a requested 
35 transcoded MPEG-2 bit stream 45 and a request signal 44 for the requested transcoded 
MPEG-2 bit stream 45 on the basis of the differential bit stream 42 stored by the 
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merging storage means 220. 

The request signal transmission means 213 is operated to transmit the request 
signal 44 for the requested transcoded MPEG-2 bit stream 45 determined by the request 
signal determining means 230. 
5 In the bit stream separating apparatus 4100, the request signal receiving 142 is 

operated to receive the request signal 44 transmitted by the request signal transmission 
means 213. 

The separating bit stream extracting means 130 is operated to extract the 
requested transcoded MPEG-2 bit stream 45 from among bit streams stored in the 
10 separating storage means 120 in response to the request signal 44. 

The second transmission means 143 is operated to transmit the requested 
transcoded MPEG-2 bit stream 45 extracted by the separating bit stream extracting 
means 130 to the bit stream merging apparatus 4200. 

Li the bit stream merging apparatus 4200, the second receiving means 212 is 
15 operated to receive the requested transcoded MPEG-2 bit stream 45 transmitted by the 
second transmission means 143 of the bit stream separating apparatus 4100. 

The merging bit stream extracting means 241 is operated to extract the 
differential bit stream 46 stored by the merging storage means 220. 

The merging means 242 is operated to merge the differential bit stream 46 
20 extracted by the merging bit stream extracting means 241 with the transcoded MPEG-2 
bit stream 45 received by the second receiving means 212 to reconstruct the original 
MPEG-2 bit stream 47. 

According to the present invention, the first transmission means 141 of the bit 
stream separating apparatus 4100 and the first receiving means 211 of the bit stream 
25 merging apparatus 4200 may transmit and receive bit streams by way of broadcasting. 

The fourth embodiment of the bit stream separating and merging system 4000 
thus constructed enables to firstly deliver the differential bit stream to a user in their 
homes and later transmit the transcoded MPEG-2 bit stream to the user in response to 
the request signal, thereby promptly delivering moving picture information and 
30 preventing the illegal copy of the moving picture information. 

V. Fifth embodiment of Bit Stream Separating and Merging System 5000 

Referring FIG. 9 of the drawings, there is shown a fifth preferred embodiment 
of a bit stream separating and merging system 5000 according to the present invention. 
35 The same constitutional elements are simply represented by the same reference 
numerals as those of the bit stream separating apparatus 1100 and the bit stream 
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merging apparatus 1200, and will be thus omitted from description for avoiding tedious 
repetition. 

The fifth preferred embodiment of the bit stream separating and merging 
system 5000 according to the present invention is shown in FIG. 9 as comprising a bit 
stream separating means 5100 and a bit stream merging apparatus 5200. 

The bit stream merging apparatus 5200 further comprises a decoding means 
280 for decoding MPEG-2 bit streams and merging bit stream converting means 271 for 
transcoding the original MPEG-2 bit stream to generate a transcoded MPEG-2 bit 
stream. The merging bit stream converting means 271 constitutes bit stream 
converting means according to the present invention. 

In the fifth embodiment of the bit stream separating and merging system 5000 
according to the present invention, the bit stream separating apparatus 5100 is adapted 
to transmit the original MPEG-2 bit stream to the bit stream merging apparatus 5200. 

The bit stream merging apparatus 5200 thus constructed is adapted to decode 
and reproduce high quality moving picture information from the original MPEG-2 bit 
stream 51 transmitted by the bit stream separating apparatus 5100, and transcode the 
original MPEG-2 bit stream 51 to generate the transcoded MPEG-2 bit stream 53 to be 
stored in the merging storage means 220. The bit stream separating apparatus 5100 is 
adapted to store the differential bit stream 52 in the separating storage means 120. 

The bit stream separating and merging system 5000 thus constructed does not 
need to store the original MPEG-2 bit stream 51, which has a large bit rate in 
comparison with bit rates of the transcoded MPEG-2 bit stream 53 and the differential 
bit stream 52, thereby enabling to save the storage capacity of the bit stream separating 
apparatus 5100 and the bit stream merging apparatus 5200. 

The operation of the bit stream separating and merging system 5000 will be 
described with reference to FIG. 9 hereinlater. The same operation as that of the bit 
stream separating and merging system 1000 will be omitted. 

In the bit stream separating apparatus 5100, the inputting means al is operated 
to input an original MPEG-2 bit stream 51 therethrough to be outputted to the bit stream 
converting means 111 and the first transmission means 141. 

The bit stream converting means 111 is operated to convert the original 
MPEG-2 bit stream 51 inputted through the inputting means al to generate the 
transcoded MPEG-2 bit stream to be outputted to the differential bit stream generating 
means 112. The bit stream converting means 111 is also operated to output the 
original MPEG-2 bit stream 51 inputted through the inputting means al to the 
differential bit stream generating means 112. 
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The differential bit stream generating means 112 is operated to input the 
original MPEG-2 bit stream 51 and the transcoded MPEG-2 bit stream from the bit 
stream converting means 111 to generate a differential bit stream 52 to be outputted to 
the separating storage means 120 through the interface out2. 

The separating storage means 120 is operated to input and store the differential 
bit stream 52 generated by the differential bit stream generating means 112. 

The first transmission means 141 is operated to input and transmit the original 
MPEG-2 bit stream 51 inputted through the inputting means al to the bit stream 
merging apparatus 5200. 

In the bit stream merging apparatus 5200, the first receiving means 211 is 
adapted to receive the original MPEG-2 bit stream 51 transmitted by the first 
transmission means 141 of the bit stream separating apparatus 5100. 

The decoding means 280 is operated to input and decode the original MPEG-2 
bit stream 51 received by the first receiving means 211. 

The merging bit stream converting means 271 is operated to input the original 
MPEG-2 bit stream 51 received by the first receiving means 211 to generate a 
transcoded MPEG-2 bit stream 53. 

The merging storage means 220 is operated to input and store the transcoded 
MPEG-2 bit stream 53 generated by the merging bit stream converting means 271. 

The request signal determining means 230 is operated to determine a requested 
differential bit stream 55 and a request signal 54 for the requested differential bit stream 
55 on the basis of the transcoded MPEG-2 bit stream 53 stored by the merging storage 
means 220. 

The request signal transmission means 213 is operated to transmit the request 
signal 54 for the requested differential bit stream 55 determined by the request signal 
determining means 230 to the bit stream separating apparatus 5100. 

In the bit stream separating apparatus 5100, the request signal receiving means 
142 is operated to receive the request signal 54 transmitted by the request signal 
transmission means 213 of the bit stream merging apparatus 5200. 

The separating bit stream extracting means 130 is operated to extract the 
requested differential bit stream 55 from among bit streams stored in the separating 
storage means 120 in response to the request signal 54. 

The second transmission means 143 is operated to transmit the requested 
differential bit stream 55 extracted by the separating bit stream extracting means 130 to 
the bit stream merging apparatus 5200. 

In the bit stream merging apparatus 5200, the second receiving means 212 is 



62 



operated to receive the requested differential bit stream 55 transmitted by the second 
transmission means 143 of the bit stream separating apparatus 5100. 

The merging bit stream extracting means 241 is operated to extract the 
transcoded MPEG-2 bit stream 56 from among bit streams stored in the merging storage 
means 220. 

The merging means 242 is operated to merge the transcoded MPEG-2 bit 
stream 56 extracted by the merging bit stream extracting means 241 with the requested 
differential bit stream 55 received by the second receiving means 212 to reconstruct the 
original MPEG-2 bit stream 57 in the desired size. 

The bit stream separating and merging system 5000 thus constructed does not 
need to store the original MPEG-2 bit stream, which has a large bit rate in comparison 
with bit rates of the transcoded MPEG-2 bit stream and the differential bit stream, 
thereby enabling to save the storage capacity of the bit stream separating apparatus 5100 
and the bit stream merging apparatus 5200. 

V!- Sixth embodiment of Bit Stream Separating and Merging System 6000 

Referring to FIG. 10 of the drawings, there is shown a sixth preferred 
embodiment of a bit stream separating and merging system 6000 according to the 
present invention. 

The sixth preferred embodiment of the bit stream separating and merging 
system 6000 according to the present invention is shown in FIG. 10 as comprising a bit 
stream separating apparatus 6100 and a bit stream merging apparatus 6200. The same 
constitutional elements are simply represented by the same reference numerals as those 
of the bit stream separating apparatus 1100 and the bit stream merging apparatus 1200, 
and will be thus omitted from description. 

The construction of the sixth embodiment of the bit stream separating and 
merging system 6000 is similar to that of the fourth embodiment of the bit stream 
separating and merging system 4000 except for the facts that the bit stream separating 
apparatus 6100 is adapted to transmit the transcoded MPEG-2 bit stream 61 and the bit 
stream merging apparatus 6200 is adapted to receive the original MPEG-2 bit stream 61 
to generate a differential bit stream 63 and store the differential bit stream 63 thus 
generated. 

The bit stream merging apparatus 6200 further comprises decoding means 280 
and merging separating means 270. The decoding means 280 is adapted to decode a 
MPEG-2 bit stream. The merging separating means 270 is adapted to input the 
original MPEG-2 bit stream 61 to generate a differential bit stream 64. The merging 
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separating means 270 constitutes merging differential coded signal generating means 
according to the present invention. 

More specifically, the merging separating means 270 includes bit stream 
converting means 271 and differential bit stream generating means 272 as shown in FIG. 
10. The bit stream converting means 271 is adapted to input the original MPEG-2 bit 
stream 60 to generate a transcoded MPEG-2 bit stream. The bit stream converting 
means 271 is adapted to output the original MPEG-2 bit stream 61 and the transcoded 
MPEG-2 bit stream thus generated to the differential bit stream generating means 272. 
The differential bit stream generating means 272 is adapted to input the original 
MPEG-2 bit stream 61 and the transcoded MPEG-2 bit stream from the bit stream 
converting means 271 to generate a differential bit stream 64. 

The bit stream separating and merging system 6000 thus constructed does not 
need to store the original MPEG-2 bit stream, which has a large bit rate in comparison 
with bit rates of the transcoded MPEG-2 bit stream and the differential bit stream, 
thereby enabling to save the storage capacity of the bit stream separating apparatus 6100 
and the bit stream merging apparatus 6200. 

The operation of the bit stream separating and merging system 6000 will be 
described with reference to FIG. 10 hereinlater. The same operation described 
hereinearlier will be omitted. 

In the bit stream separating apparatus 6100, the inputting means al is operated 
to input an original MPEG-2 bit stream 61 therethrough to be outputted to the bit stream 
converting means 111 and the first transmission means 141. 

The bit stream converting means 111 is operated to convert the original 
MPEG-2 bit stream 61 inputted through the inputting means al to generate a transcoded 
MPEG-2 bit stream 62 to be outputted to the merging storage means 120 through the 
interface outl. 

The separating storage means 120 is operated to input and store the transcoded 
MPEG-2 bit stream 62 generated by the bit stream converting means 111. 

The first transmission means 141 is operated to transmit the original MPEG-2 
bit stream 61 inputted through inputting means al to the bit stream merging apparatus 
6200. 

m the bit stream merging apparatus 6200, the first receiving means 211 is 
operated to receive the original MPEG-2 bit stream 61 transmitted by the first 
transmission means 141 of the bit stream separating apparatus 6100. 

The decoding means 280 is operated to decode the original MPEG-2 bit stream 
61 received by the first receiving means 211. 
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The merging bit stream converting means 271 is operated to input the original 
MPEG-2 bit stream 61 received by the first receiving means 211 to generate a 
transcoded MPEG-2 bit stream. 

The merging differential bit stream generating means 272 is operated to input 
the original MPEG-2 bit stream 61 received by the first receiving means 211 and the 
transcoded MPEG-2 bit stream generated by the merging bit stream converting means 
271 to generate the differential bit stream 63. 

The merging storage means 220 is operated to store the differential bit stream 
63 thus generated by the merging separating means 270. 

The request signal determining means 230 is operated to determine a requested 
transcoded MPEG-2 bit stream 65 and a request signal 64 for the requested transcoded 
MPEG-2 bit stream 65 on the basis of the differential bit stream 63 stored by the 
merging storage means 220. 

The request signal transmission means 213 is operated to transmit the request 
signal 64 for the requested transcoded MPEG-2 bit stream 65 determined by the request 
signal detennining means 230 to the bit stream separating apparatus 6100. 

In the bit stream separating apparatus 6100, the request signal receiving means 
142 is operated to receive the request signal 64 transmitted by the request signal 
transmission means 213 of the bit stream merging apparatus 6200. 

The separating bit stream extracting means 130 is operated to extract the 
requested transcoded MPEG-2 bit stream 65 from among bit streams stored in the 
separating storage means 120 in response to the request signal 64. 

The second transmission means 143 is operated to transmit the requested 
transcoded MPEG-2 bit stream 65 extracted by the separating bit stream extracting 
means 130 to the bit stream merging apparatus 6200. 

In the bit stream merging apparatus 6200, the second receiving means 212 is 
operated to receive the requested transcoded MPEG-2 bit stream 65 transmitted by the 
second transmission means 143 of the bit stream separating apparatus 6100. 

The merging bit stream extracting means 241 is operated to extract the 
differential MPEG-2 bit stream 66 from among bit streams stored in the merging storage 
means 220. 

The merging means 242 is operated to merge the differential bit stream 66 
extracted by the merging bit stream extracting means 241 with the requested transcoded 
MPEG-2 bit stream 65 received by the second receiving means 212 to reconstruct the 
original MPEG-2 bit stream 67 in the desired size. 

The bit stream separating and merging system 6000 thus constructed does not 
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need to store the original MPEG-2 bit stream, which has a large bit rate in comparison 
with bit rates of the transcoded MPEG-2 bit stream and the differential bit stream, 
thereby enabling to save the storage capacity of the bit stream separating apparatus 6100 
and the bit stream merging apparatus 6200. 

vn - Seventh embodiment of Bit Stream Separating and Merging System 7000 

Referring to FIG. 11 of the drawings, there is shown a seventh preferred 
embodiment of a bit stream separating and merging system 7000 according to the 
present invention. 

Each of the above described embodiments of the bit stream separating and 
merging systems 1000 to 6000 comprises a single bit stream separating apparatus for 
inputting an original MPEG-2 bit stream to separate into a transcoded MPEG-2 bit 
stream and a differential bit stream, and a single bit stream merging apparatus for 
inputting a transcoded MPEG-2 bit stream and a differential MPEG-2 bit stream to 
reconstruct an original MPEG-2 bit stream. 

The seventh preferred embodiment of the bit stream separating and merging 
system 7000, on the other hand, as best shown in FIG. 11, comprises a multi-output bit 
stream separating apparatus 7100 for inputting an original MPEG-2 bit stream to 
separate into a plurality of transcoded MPEG-2 bit streams and a plurality of differential 
bit streams; and a multi-input bit stream merging apparatus 7200 for inputting a 
plurality of transcoded MPEG-2 bit streams and a plurality of differential bit streams to 
reconstruct the original MPEG-2 bit. According to the present invention, the 
multi-input bit stream merging apparatus 7200 can also output a plurality of transcoded 
MPEG-2 bit streams. 

In the bit stream separating and merging system 7000 thus constructed, the 
multi-output bit stream separating apparatus 7100 can input, for instance, an original 
MPEG-2 bit stream having a large bit rate to separate into and transmit one or more 
transcoded MPEG-2 bit streams and a plurality of differential bit streams and the 
multi-input bit stream merging apparatus 7200 can input and merge the one or more 
transcoded MPEG-2 bit streams and the differential bit streams thus multiple-times 
separated to reconstruct the original MPEG-2 bit stream of the large bit rate. 
Alternatively, the multi-input bit stream merging apparatus 7200 can reconstruct and 
output a plurality of transcoded MPEG-2 bit stream in addition to the original MPE-2 
bit stream. Each of the transcoded MPEG-2 bit streams and the differential bit streams 
thus multiple-times separated has a small bit rate in comparison with a bit rate of the 
original MPEG-2 bit stream. The bit stream separating and merging system 7000 
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makes it possible to promptly and reliably transmit and receive an original MPEG-2 bit 
stream having a large bit rate by transmitting and receiving one or more transcoded 
MPEG-2 bit streams and a plurality of differential bit streams in place of the original 
MPEG-2 bit stream. 

The constructions of the multi-output bit stream separating apparatus 7100 and 
the multi-input bit stream merging unit 7200 will be described in detail before 
describing the operation of the bit stream separating and merging system 7000. 

VII-A Multi-output bit stream separating apparatus 7100 

Referring to FIG. 12 of the drawings, there is shown a multi-output bit stream 
separating apparatus 7100 for inputting an original MPEG-2 bit stream 71 to separate 
into one transcoded MPEG-2 bit streams and a plurality of differential bit streams. As 
shown in FIG. 12, the multi-output bit stream separating apparatus 7100 comprises a 
plurality (the number m) of bit stream separating units 71001 to 7100m including a 1st 
bit stream separating unit 71001 up to a m-th bit stream separating unit 7100m wherein 
m is an integer not less than two. 

Each of the bit stream separating units 71001 to 7100m is entirely same in 
construction as that of the bit stream separating apparatus 1100 according to the present 
invention, which has previously been mentioned, and adapted to input a MPEG-2 bit 
stream to be transcoded, to separate into a transcoded MPEG-2 bit stream and a 
differential bit stream, which is a difference between the transcoded MPEG-2 bit stream 
and the MPEG-2 bit stream. The same constitutional elements are simply represented 
by the same reference numerals as those of the bit stream separating apparatus 1100 and 
will be thus omitted from description. 

The multi-output bit stream separating apparatus 7100 will be described in 
reference to FIG. 12, hereinlater. 

The 1st bit stream separating unit 71001 is adapted to input the original 
MPEG-2 bit stream 71 having a bit rate of 10 Mbps to separate into a 1st transcoded 
MPEG-2 bit stream 72.1 having a bit rate of 8Mbps and a 1st differential bit stream 73.1 
having a bit rate of 2Mbps. The 1 st differential bit stream 73 . 1 is a difference between 
the original MPEG-2 bit stream 71 and the 1st transcoded MPEG-2 bit stream 72.1. 
The 1st bit stream separating unit 71001 is adapted to output the 1st transcoded 
MPEG-2 bit stream 72.1 to the 2nd bit stream separating unit 71002. 

The 2nd bit stream separating unit 71002 is adapted to input the 1st transcoded 
MPEG-2 bit stream 72.1 having a bit rate of 8 Mbps from the 1st bit stream separating 
unit 71001 to separate into a 2nd transcoded MPEG-2 bit stream 72.2 having a bit rate 
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of 6Mbps and a 2nd differential bit stream 73.2 having a bit rate of 2Mbps. The 2nd 
differential bit stream 73.2 is a difference between the 1st transcoded MPEG-2 bit 
stream 72.1 and the 2nd transcoded MPEG-2 bit stream 72.2. The 2nd bit stream 
separating unit 71002 is adapted to output the 2nd transcoded MPEG-2 bit stream 72.3 
to the 3rd bit stream separating unit 71003. 

The multi-output bit stream separating apparatus 7100 thus constructed can 
transmit the original MPEG-2 bit stream having a bit rate of 10Mbps by transmitting 
one transcoded MPEG-2 bit stream and a plurality of differential bit streams each 
having a bit rate lower than 10Mbps. 

Any one of the bit stream separating units 71001 to 7100m is hereinlater 
referred to as i-th bit stream separating unit 7100i wherein i is an integer equal to or less 
than m. 

The i-th bit stream separating unit 7100i is adapted to input an (i-l)-th 
transcoded MPEG-2 bit stream 72.(1-1) from the (i-1) th bit stream separating unit 
7100M to separate into an i-th transcoded MPEG-2 bit stream 72.i and an i-th 
differential bit stream 73.i. The i-th bit stream separating unit 7100i is adapted to 
output the i-th transcoded MPEG-2 bit stream 72.i to the (i+l)-th bit stream separating 
unit 7100i+l . Here, the i-th differential bit stream 73 .i is intended to mean a difference 
between the (i-l)-th transcoded MPEG-2 bit stream 72.(i-l) and the i-th transcoded 
MPEG-2 bit stream 72.i. 

According to the present invention, any one of the bit stream separating units 
71001 to 7100m, i.e., an i-th bit stream separating unit 7100i can transmit i-th 
transcoded MPEG-2 bit stream 72.1 to an external device such as a decoder. The 
multi-output bit stream separating apparatus 7100 thus constructed can input an original 
MPEG-2 bit stream to output a plurality of transcoded MPEG-2 bit stream and a 
plurality of differential bit streams. 

For better understanding, the multi-output bit stream separating apparatus 7100 
will be described in detail in reference to the i-th bit stream separating unit 7100i. 

The i-th bit stream separating unit 7100i is similar in construction as the bit 
stream separating apparatus 1100 shown in FIG. 2 as comprising an inputting terminal 
INi, i-th bit stream converting means llli, i-th differential bit stream generating means 
112i, i-th separating storage means 120i, i-th first transmission means 141i, i-th request 
signal receiving means 142i, i-th bit stream extracting means 130i, i-th second 
transmission means 143i, and i-th outputting interface OUTi. 

The i-th inputting means INi is adapted to input the (i-l)-th transcoded 
MPEG-2 bit stream 72.(1-1) therethrough from the (i-l)-th bit stream separating unit 
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7100i-l. Here, 0-th transcoded MPEG-2 bit stream is the original MPEG-2 bit stream. 
0-th bit stream separating unit is intended to mean the inputting means al. 

The (i-l)-th transcoded MPEG-2 bit stream 72.(i-l) is generated as a result of 
encoding original moving picture sequence signal and consists of a series of (i-l)-th 
5 picture information having (i-l)-th coefficient information. The (i-l)-th coefficient 
information includes a matrix of (i-l)-th coefficients. 

The i-th bit stream converting means llli is adapted to convert the (i-l)-th 
transcoded MPEG-2 bit stream 72.( i-1) inputted through the i-th inputting means INI to 
generate the i-th transcoded MPEG-2 bit stream 72.i. The i-th bit stream converting 

10 means llli is adapted to output the i-th transcoded MPEG-2 bit stream 72.i thus 
generated to the (i+l)-th mputting means INi+1 of the (i+l)-th bit stream separating unit 
7100i+i through the interface outl. The i-th bit stream converting means llli is also 
adapted to output the (i-l)-th transcoded MPEG-2 bit stream 72.( i-1) and the i-th 
transcoded MPEG-2 bit stream 72.i to the i-th differential bit stream generating means 

15 112i. 

The i-th differential bit stream generating means 112i is adapted to input the 
(i-l)-th transcoded MPEG-2 bit stream 72.( i-1) and the i-th transcoded MPEG-2 bit 
stream 72.i from the bit stream converting means llli to generate an i-th differential bit 
stream 73 .i on the basis of the (i-l)-th second coefficient information obtained from the 

20 series of (i-l)-th second picture information of the (i-l)-th transcoded MPEG-2 bit 
stream 72.( i-1), and the i-th second coefficient information obtained from the series of 
the i-th second picture information of the transcoded MPEG-2 bit stream 72.i. The i-th 
differential bit stream 73.i is intended to mean a difference between the (i-l)-th 
transcoded MPEG-2 bit stream 72.( i-1) and the i-th transcoded MPEG-2 bit stream 

25 72.i. 

The i-th separating storage means 120i is adapted to selectively store the 
(i-l)-th transcoded MPEG-2 bit stream 72.( i-1), the i-th transcoded MPEG-2 bit stream 
72.i, and the i-th differential bit stream 73 .i. 

The i-th first transmission means 141 i is adapted to selectively transmit the 
30 (i-l)-th transcoded MPEG-2 bit stream, the i-th transcoded MPEG-2 bit stream 72.i, and 
the i-th differential bit stream 73 i to an external device such as, for instance, the i-th bit 
stream merging unit 7200i of the multi-input bit stream merging apparatus 7200. 

The i-th request signal receiving means 142i is adapted to receive a request 
signal indicative of a requested bit stream to be transmitted. The request signal 
35 indicative of the requested bit stream is determined on the basis of a base signal, which 
is any one of the (i-l)-th transcoded MPEG-2 bit stream 72.( i-1), the i-th transcoded 
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MPEG-2 bit stream 72.i, or the i-th differential bit stream 73 A. 

The i-th separating bit stream extracting means 130i is adapted to extract the 
requested bit stream from among bit streams stored in the i-th separating storage means 
120i in response to the request signal. 
5 The i-th second transmission means 143i is adapted to transmit the requested 

bit stream extracted by the i-th separating bit stream extracting means 130i. 

VII-B Multi-input bit stream merging apparatus 7200 

Referring to FIG. 13 of the drawings, there is shown a multi-input bit stream 
10 merging apparatus 7200 for inputting one or more transcoded MPEG-2 bit streams and 
a plurality of differential bit streams to reconstruct an original MPEG-2 bit stream. As 
shown in FIG. 13, the multi-input bit stream merging apparatus 7200 comprises a 
plurality (the number n) of bit stream merging units 72001 to 7200n including a 1st bit 
stream merging unit 72001 up to a n-th bit stream merging unit 7200i wherein n is an 
15 integer not less than two. 

Each of the bit stream merging units 72001 to 7200n is entirely same in 
construction as the bit stream merging apparatus 1200 according to the present 
invention, which has previously been mentioned, and adapted to input a transcoded 
MPEG-2 bit stream and a differential bit stream to reconstruct a MPEG-2 bit stream 
20 before separated into the transcoded MPEG-2 bit stream and the differential bit stream 
The same constitutional elements are simply represented by the same reference 
numerals as those of the bit stream separating apparatus 1100 and will be thus omitted 
from description. 

The multi-input bit stream merging apparatus 7200 will be described in 
25 reference to FIG. 13 hereinlater. 

The 2nd bit stream merging unit 72002 is adapted to input the 2nd transcoded 
MPEG-2 bit stream 72.2 having a bit rate of 6Mbps from the 3rd bit stream merging 
unit 72003, and the 2nd differential bit stream 73.2 having a bit rate of 2 Mbps from an 
external device such as, for instance, the 2nd bit stream separating unit 71002, to 
30 reconstruct the 1st transcoded MPEG-2 bit stream 72.1 having a bit rate of 8Mbps. 
The 2nd bit stream merging unit 72002 is adapted to output the 1st transcoded MPEG-2 
bit stream thus reconstructed to the 1st bit stream merging unit 72001 . 

The 1st bit stream merging unit 72001 is adapted to input the 1st transcoded 
MPEG-2 bit stream 72.1 having a bit rate of 8Mbps from the 2nd bit stream merging 
35 unit 72002, and the 1st differential bit stream 73.1 having a bit rate of 2Mbps from an 
external device such as, for instance, the 1st bit stream separating unit 71001 to 
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reconstruct the original MPEG-2 bit stream 71 having a bit rate of 10Mbps. 

Any one of the bit stream separating units 81001 to 8100m is hereinlater 
referred to as i-th bit stream separating unit 8100i wherein i is an integer equal to or less 
than n. This means that the i-th bit stream merging unit 7200i is adapted to input an 
i-th transcoded MPEG-2 bit stream 721 and an i-th differential bit stream 73 J to 
reconstruct a (i-l)-th transcoded MPEG-2 bit stream wherein i is an integer equal to or 
less than n. 

In this embodiment, the i-th bit stream merging unit 7200i is adapted to input 
the i-th transcoded MPEG-2 bit stream 72 J from the (i+l)-th bit stream merging unit 
7200i+l and the i-th differential bit stream 73.i from an external device such as, for 
instance, the i-th bit stream separating unit 7100i. The i-th bit stream merging unit 
7200i is adapted to output the (i-l)-th transcoded MPEG-2 bit stream thus reconstructed 
to the (i-l)-th bit stream merging unit 7200M. 

The multi-input bit stream merging apparatus 7200 thus constructed can 
receive an original MPEG-2 bit stream having a bit rate of, for instance, 10Mbps by 
receiving one single transcoded MPEG-2 bit stream and a plurality of differential bit 
streams each having a bit rate lower than 10 Mbps. 

The i-th bit stream merging unit 7200i can, however, input any one of the i-th 
transcoded MPEG-2 bit stream 72 J and the i-th differential bit stream 73 .i from the 
(i+l)-th bit stream merging unit 7200i+l and the other one of them from an external 
device such as, for instance, the i-th bit stream separating unit 7100i. Furthermore, the 
i-th bit stream merging unit 7200i can output the (i-l)-th transcoded MPEG-2 bit stream 
thus reconstructed to an external device such as a decoder. 

The multi-input bit stream merging apparatus 7200 thus constructed can input a 
plurality of transcoded MPEG-2 bit streams and a plurality of differential bit streams to 
output a plurality of transcoded MPEG-2 bit streams. 

For better understanding, the multi-input bit stream merging apparatus 7200 
will be described in detail in reference to the i-th bit stream merging unit 7200i will be 
described in detail. 

The i-th bit stream merging unit 7200i is similar in construction as the bit 
stream separating apparatus 1200 shown in FIG. 4 as comprising inputting interfaces, 
i-th first receiving means 21 li, i-th merging storage means 220i, i-th request signal 
deterniining means 230i, i-th request signal transmission means 213i, i-th second 
receiving means 212i, i-th merging bit stream extracting means 241i, i-th merging 
means 242i, and outputting means OUTi. 

The i-th first receiving means 21 li is adapted to receive a base bit stream. In 
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this embodiment, the base bit stream is an i-th transcoded MPEG-2 bit stream 72.1. 
This means that the i-th first receiving means 211i is adapted to receive the base bit 
stream, i.e., the i-th transcoded MPEG-2 bit stream 72J from the (i+l)-th bit stream 
merging unit 7200i+l . 

The i-th first receiving means 21 li may receive the base bit stream from the 
i-th bit stream separating unit 710Qi, and the base bit stream may be any one of the i-th 
transcoded MPEG-2 bit stream 72.1, the (i-l)-th transcoded MPEG-2 bit stream 72.(i-l), 
and the i-th differential bit stream 73. i. 

The i-th merging storage means 220i is adapted to store the base bit stream 
received by the i-th first receiving means 21 li. 

The i-th request signal detennining means 230i is adapted to determine a 
requested bit stream and a request signal for the requested bit stream on the basis of the 
base bit stream stored by the i-th merging storage means 220i. If the base bit stream is 
the (i-l)-th transcoded MPEG-2 bit stream 72.(i-l), the i-th request signal determining 
means 230i is adapted to determine no request signal, and the i-th bit stream merging 
unit 7200i is adapted to output the (i-l)-th transcoded MPEG-2 bit stream 72.(i-l) 
therethrough. Li this embodiment, the base bit stream is the i-th transcoded MPEG-2 
bit stream 72.i, and the i-th request signal determining means 230i is adapted to 
determine a requested bit stream, i.e., an i-th differential bit stream 73 J, and a request 
signal for the requested bit stream on the basis of the i-th transcoded MPEG-2 bit stream 
72.i stored by the i-th merging storage means 220i. 

The i-th request signal transmission means 213i is adapted to transmit the 
request signal for the requested bit stream determined by the i-th request signal 
determining means 230i to the bit stream separating unit 7100i. 

The i-th second receiving means 212i is adapted to receive the requested bit 

stream. 

The i-th merging bit stream extracting means 24 li is adapted to extract the base 
bit stream from among bit streams stored in the i-th merging storage means 220i. 

The i-th merging means 242i is adapted to merge the base bit stream, i.e., the 
i-th transcoded MPEG-2 bit stream 72.i, extracted by the i-th merging bit stream 
extracting means 241i with the requested bit stream, i.e., i-th differential bit stream 73 .i, 
received by the i-th second receiving means 212i to reconstruct the (i-l)-th transcoded 
MPEG-2 bit stream 72.(i-l) on the basis of the i-th second coefficient information 
obtained from the series of i-th second picture information of the i-th transcoded 
MPEG-2 bit stream 72.i, and the i-th differential coefficient information obtained from 
the i-th differential bit stream 73 .i. 
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The i-th outputting means OUTi is adapted to input the reconstructed (i-l)-th 
transcoded MPEG-2 bit stream from the i-th merging means 242i to be outputted 
therethrough to the (i-l)-th bit stream merging unit 7200M. 

According to the present invention, the i-th outputting means OUTi can output 
the reconstructed (i-l)-th transcoded MPEG-2 bit stream to an external device, such as a 
decoder as well. 

As will be seen from the foregoing description, the multi-input bit stream 
merging apparatus 7200 thus constructed can input one or more transcoded MPEG-2 bit 
streams and a plurality of differential bit streams to one or more MPEG-2 bit streams 
before transcoded, thereby making it possible for a user to selectively decode 
transcoded MPEG-bit streams to reproduce a moving picture information of a desired 
picture quality. 

VII-C Operation of Bit Stream Separating and Merging System 7000 

Referring to FIG. 11 of the drawings, there is shown a seventh preferred 
embodiment of a bit stream separating and merging system 7000 according to the 
present invention. 

The seventh preferred embodiment of the bit stream separating and merging 
system 7000 is shown in FIG. 11 as comprising a multi-output bit stream separating 
apparatus 7100 for inputting an original MPEG-2 bit stream to separate into one or 
more transcoded MPEG-2 bit streams and a plurality of differential bit streams; and a 
multi-input bit stream merging apparatus 7200 for inputting one or more transcoded 
MPEG-2 bit streams and a plurality of differential bit streams to reconstruct the original 
MPEG-2 bit stream. 

The multi-output bit stream separating apparatus 7100 comprises a plurality 
(the number m) of bit stream separating units 71001 to 7100m including a 1st bit stream 
separating unit 71001 up to a m-th bit stream separating unit 7100m wherein m is an 
integer not less than two. 

The multi-input bit stream merging apparatus 7200 comprises a plurality (the 
number n) of the bit stream merging units 72001 to 7200n including a 1st bit stream 
merging unit 72001 up to a n-th bit stream merging unit 7200n wherein n is an integer 
not less than two. Furthermore, n can be equal to or less than m. 

The constructions of the bit stream separating apparatus 7100 and the bit 
stream merging apparatus 7200 have already been described. 

The operation of the seventh preferred embodiment of the bit stream separating 
and merging system 7000 will be described hereinlater, with reference to the i-th bit 
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stream separating unit 7100i, and the i-th bit stream merging unit 7200i. 

According to the present invention, the multi-output bit stream separating 
apparatus 7100 is adapted to input an original MPEG-2 bit stream to separate into a 
plurality of transcoded MPEG-2 bit streams and a plurality of differential bit streams; 
and a multi-input bit stream merging apparatus 7200 is adapted to input a plurality of 
transcoded MPEG-2 bit streams and a plurality of differential bit streams to reconstruct 
the original MPEG-2 bit stream. 

In this embodiment, the multi-output bit stream separating apparatus 7100, 
however, is operated to input an original MPEG-2 bit stream to separate into one 
transcoded MPEG-2 bit stream and a plurality of differential bit streams; and a 
multi-input bit stream merging apparatus 7200 is operated to input one transcoded 
MPEG-2 bit streams and a plurality of differential bit streams to reconstruct the original 
MPEG-2 bit stream. 

In the i-th bit stream merging unit 7200i, the i-th inputting means INI is 
operated to input an (i-l)-th transcoded MPEG-2 bit stream 72.(i-l) therethrough from 
the (i-l)-th bit stream separating unit 7100i-l. 

The i-th bit stream converting means llli is operated to convert the (i-l)-th 
transcoded MPEG-2 bit stream 72.(i-l) inputted through the i-th inputting means INi to 
generate an i-th transcoded MPEG-2 bit stream 72.L The i-th bit stream converting 
means llli is also operated to output the i-th transcoded MPEG-2 bit stream 72.i thus 
generated to the (i+l)-th inputting means INi+1 of the (i+l)-th bit stream separating unit 
7100i+l through the interface i-th outl. The i-th bit stream converting means llli is 
also operated to output the (i-l)-th transcoded MPEG-2 bit stream 72.( i-1) and the i-th 
transcoded MPEG-2 bit stream 72.i to the i-th differential bit stream generating means 
112i. 

The i-th differential bit stream generating means 112i is operated to input the 
(i-l)-th transcoded MPEG-2 bit stream 72.i-l and the i-th transcoded MPEG-2 bit 
stream 72.i from the i-th bit stream converting means llli to generate an i-th differential 
bit stream 73 .i on the basis of the (i-l)-th second coefficient information obtained from 
the series of (i-l)-th second picture information of the (i-l)-th transcoded MPEG-2 bit 
stream 72J-1, and the i-th second coefficient information obtained from the series of the 
i-th second picture information of the i-th transcoded MPEG-2 bit stream 72.L 

The i-th separating storage means 120i is adapted to selectively store the 
(i-l)-th transcoded MPEG-2 bit stream 72.1-1, the i-th transcoded MPEG-2 bit stream 
72.i, and the i-th differential bit stream 73 .i. In this embodiment, the i-th separating 
storage means 120i is operated to store the the i-th differential bit stream 73 J. 



74 



The i-th first transmission means 141i is adapted to selectively transmit the 
(i-l)-th transcoded MPEG-2 bit stream 72.i-l, the i-th transcoded MPEG-2 bit stream 
721, and the i-th differential bit stream 73 .i to the i-th bit stream merging unit 7200L 

In the i-th bit stream merging unit 7200i, the i-th first receiving means 21 li is 
operated to receive a base bit stream, i.e., an i-th transcoded MPEG-2 bit stream 72.i, 
from the (i+l)-th bit stream merging unit 7200i+l. 

The i-th merging storage means 220i is operated to store the base bit stream 
received by the i-th first receiving means 21 li. 

The i-th request signal determining means 230i is operated to determine a 
requested bit stream, and a request signal for the requested bit stream, i.e., an i-th 
differential bit stream 73 i, on the basis of the base bit stream stored by the i-th merging 
storage means 220L 

The i-th request signal transmission means 213i is operated to transmit the 
request signal for the requested bit stream determined by the i-th request signal 
determining means 230i to the i-th bit stream separating unit 7100i. 

In the i-th bit stream separating unit 7100i, the i-th request signal receiving 
means 142i is operated to receive the request signal transmitted by the i-th request 
signal transmission means 213i of the i-th bit stream merging unit 7200i. 

The i-th separating bit stream extracting means 130i is operated to extract the 
requested bit stream, i.e., an i-th differential bit stream 73 .i, from among bit streams 
stored in the i-th separating storage means 120i in response to the request signal. 

The i-th second transmission means 143i is operated to transmit the requested 
bit stream extracted by the i-th separating bit stream extracting means 130i to the i-th bit 
stream merging unit 7200L 

In the i-th bit stream merging unit 7200i, the i-th second receiving means 212i 
is operated to receiving the requested bit stream transmitted by the i-th second 
transmission means 143i from the i-th bit stream separating unit 7100i. 

The i-th merging bit stream extracting means 241i is operated to extract the 
base bit stream from the i-th merging storage means 220i; 

The i-th merging means 242i is operated to merge the base bit stream, i.e., i-th 
transcoded MPEG-2 bit stream 72.i, extracted by the i-th merging bit stream extracting 
means 241i with the requested bit stream, i.e., an i-th differential bit stream 731, 
received by the i-th second receiving means 212i on the basis of the i-th second 
coefficient information obtained from the series of second picture information of the i-th 
transcoded MPEG-2 bit stream 72.i, and the i-th differential coefficient information 
obtained from the i-th differential bit stream 73 .i to reconstruct the (i-l)-th transcoded 
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MPEG-2 bit stream 72.(i-l). 

The i-th outputting means OUTi is operated to input the reconstructed (i-l)-th 
transcoded MPEG-2 bit stream 72.(M) from the i-th merging means 242i to be 
outputted therethrough to the (i-l)-th bit stream merging unit 7200i-l. 

Furthermore, the number of the bit stream merging units 72001 to 7200n can 
be less than that of the bit stream separating units 71001 to 7100m, i.e., n is less than m. 

This means that the n-th bit stream merging unit 7200n can input the n-th 
transcoded MPEG-2 bit stream and n-th differential bit stream from the n-th bit stream 
separating unit 7100n to reconstruct the (n-l)-th transcoded MPEG-2 bit stream. 

In the bit stream separating and merging system 7000 thus constructed, the 
multi-output bit stream separating apparatus 7100 can input, for instance, an original 
MPEG-2 bit stream having a large bit rate to separate into and transmit one or more 
transcoded MPEG-2 bit streams and a plurality of differential bit streams and the 
multi-input bit stream merging apparatus 7200 can input and merge the one or more 
transcoded MPEG-2 bit streams and the differential bit streams thus multiple-times 
separated to reconstruct the original MPEG-2 bit stream of the large bit rate. Each of 
the one or more transcoded MPEG-2 bit streams and the differential bit streams thus 
multiple-times separated has a bit rate lower than that of the original MPEG-2 bit 
stream. The bit stream separating and merging system 7000 therefore makes it 
possible to promptly and reliably transmit and receive an original MPEG-2 bit stream 
having a large bit rate by transmitting and receiving a plurality of transcoded MPEG-2 
bit streams and a plurality of differential bit streams multiple-times separated in place of 
the original MPEG-2 bit stream. 

Furthermore, the i-th outputting means OUTi of the i-th bit stream merging 
unit 7200i of the multi-input bit stream merging apparatus 7200 according to the present 
invention can output the reconstructed (i-l)-th transcoded MPEG-2 bit stream to an 
external device, such as a decoder. The multi-input bit stream merging apparatus 7200 
thus constructed can input one or more transcoded MPEG-2 bit streams and a plurality 
of differential bit streams to output a plurality of transcoded MPEG-2 bit streams, 
thereby making it possible for a user to selectively decode a transcoded MPEG-bit 
stream having a desired bit rate to reproduce an original moving picture information of a 
desired picture quality. 

vm - Eighth embodiment of Bit Stream Separating and Merging System 8000 

There is provided an eighth preferred embodiment of the bit stream separating 
and merging system 8000 comprising a multi-output bit stream separating apparatus 
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8100 for inputting an original MPEG-2 bit stream to separate into one or more 
transcoded MPEG-2 bit streams and a plurality of differential bit streams; and a 
multi-input bit stream merging apparatus 8200 for inputting a one or more transcoded 
MPEG-2 bit streams and a plurality of differential bit streams to reconstruct the original 
MPEG-2 bit stream. 

The multi-output bit stream separating apparatus 8100 comprises a plurality of 
bit stream separating units 81001 to 8100m including a 1st bit stream separating unit 
81001 up to a m-th bit stream separating unit 8100m wherein m is an integer not less 
than two. 

The multi-input bit stream merging apparatus 8200 comprises a plurality of bit 
stream merging units 82001 to 8200n including a 1st bit stream merging unit 81001 up 
to a n-th bit stream merging unit 8100n wherein n is an integer not less than two. 

The multi-output bit stream separating apparatus according to the present 
invention may comprise one or more of bit stream separating units which are the same 
in construction as any one or more of the bit stream separating apparatuses 1100, 2100, 
3100, 4100, 5100, and 6100. 

Similarly, the multi-input bit stream merging apparatus according to the present 
invention may comprise one or more of bit stream merging units which are the same in 
construction as any one or more of the bit stream merging apparatus 1200, 1200, 2200, 
3200, 4200, 5200, and 6200. 

The multi-output bit stream separating apparatus 8100 comprises a plurality of 
bit stream separating units 81001 to 8100m. Any one of the bit stream separating units 
81001 to 8100m is hereinlater referred to as i-th bit stream separating unit 8100i 
wherein i is an integer equal to or less than m. 

The i-th bit stream separating units of the bit stream separating units 81001 to 
8100m of the multi-output bit stream separating apparatus 8100 is same in the 
construction as the bit stream separating apparatus 2100 shown in FIG. 6 as comprising 
as comprising an inputting terminal INi, i-th bit stream converting means llli, i-th 
differential bit stream generating means 112i, i-th separating storage means 120i, i-th 
first transmission means 141i, i-th request signal receiving means 142i, i-th bit stream 
extracting means 130i, i-th second transmission means 143i, and i-th outputting 
interface OUTi. 

The multi-input bit stream merging apparatus 8200 comprises a plurality of bit 
stream merging units 82001 to 8200m. Any one of the bit stream merging units 82001 
to 8200m is hereinlater referred to as i-th bit stream merging unit 8200i wherein i is an 
integer equal to or less than m. 
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The i-th bit stream merging units of the bit stream merging units 82001 to 
8200m of the multi-output bit stream merging apparatus 8200 is same in the 
construction as the bit stream merging apparatus 2200shown in FIG. 6 as comprising 
inputting interfaces, i-th first receiving means 21 li, i-th merging storage means 220i, 
i-th decoding means 225i, i-th request signal deterrnining means 230i, i-th request signal 
transmission means 213i, i-th second receiving means 212i, i-th merging bit stream 
extracting means 241i, i-th merging means 242i, and outputting means OUTi. 

This means that the bit stream separating units 81001 to 8100n-l are adapted to 
store differential bit streams in their respective separating storage means and transmit 
transcoded MPEG-2 bit streams to subsequently placed bit stream separating units 
82002 to 8200n. The bit stream separating unit n is adapted to transmit the transcoded 
MPEG-2 bit stream to the bit stream merging unit n. The bit stream merging unit 
8200n is adapted to receive the transcoded MPEG-2 bit stream and the differential bit 
stream from the bit stream separating unit n, and the bit stream merging units 8200n-l 
to 82001 are adapted to receive the transcoded MPEG-2 bit streams from the previously 
placed bit stream merging units 8200n to 82002 and bit streams from the respective bit 
stream merging units 8200n-l to 82001. 

The operation of the bit stream separating and merging system 8000 according 
to the present invention will be described hereinlater with reference to the i-th bit stream 
separating unit 8100i, and the i-th bit stream merging unit 8200i. The operation of the 
bit stream separating and merging system 8000 as those of the bit stream separating and 
merging system 6000 will be omitted for avoiding tedious repetition. The same 
constitutional elements are simply represented by the same reference numerals. 

In the i-th bit stream separating unit 8100i, the i-th inputting terminal INi is 
operated to receive an (i-l)-th transcoded MPEG-2 bit stream 72.( i-1) from a (i-l)th bit 
stream separating unit 8100i-l. 

The i-th bit stream converting means llli is operated to convert the (i-l)-th 
transcoded MPEG-2 bit stream 72.( i-1) inputted through the i-th inputting means INI to 
generate an i-th transcoded MPEG-2 bit stream 72.i. The i-th bit stream converting 
means llli is operated to output the i-th transcoded MPEG-2 bit stream 72.i thus 
generated to the (i+l)-th inputting means INi+1 of the (i+l)-th bit stream separating unit 
8100i+l through the interface outl. The i-th bit stream converting means llli is also 
operated to output the (i-l)-th transcoded MPEG-2 bit stream 72.( i-1) and the i-th 
transcoded MPEG-2 bit stream 72.1 to the i-th differential bit stream generating means 
112i. 

The i-th differential bit stream generating means 112i is operated to input the 
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(i-l)-th transcoded MPEG-2 bit stream 72.M and the i-th transcoded MPEG-2 bit 
stream 72.i from the i-th bit stream converting means 1 Hi to generate an i-th differential 
bit stream 73 .i on the basis of the (i-l)-th second coefficient information obtained from 
the series of (i-l)-th second picture information of the (i-l)-th transcoded MPEG-2 bit 
5 stream 72.i-l, and the i-th second coefficient information obtained from the series of the 
i-th second picture information of the i-th transcoded MPEG-2 bit stream 72 .i. 

The i-th separating storage means 120i is operated to store the i-th differential 
bit stream 73 J generated by the i-th differential bit stream generating means 1 12i. 

In the i-th bit stream merging unit 8200i, the i-th first receiving means 21 li is 
10 operated to receive the i-th transcoded MPEG-2 bit stream 72.i from outputting means 
OUTi+1 of the (i+l)-th bit stream merging unit 8200i+l. 

The i-th decoding means 225i is operated to decode the i-th transcoded 
MPEG-2 bit stream 72.i. 

The i-th merging storage means 220i is operated to store the i-th transcoded 
15 MPEG-2 bit stream 72.i received by the i-th first receiving means 211i. 

The i-th request signal determining means 230i is operated to detennine a 
requested differential bit stream and a request signal for the requested differential bit 
stream on the basis of the i-th transcoded MPEG-2 bit stream 72.i stored by the i-th 
merging storage means 220i. 
20 The i-th request signal transmission means 213i is operated to transmit the 

request signal for the requested differential bit stream determined by the i-th request 
signal determining means 230i. 

In the i-th bit stream separating unit 8100i, the i-th request signal receiving 
means 142i is operated to receive the request signal transmitted by the i-th request 
25 signal transmission means 213i. 

The i-th separating bit stream extracting means 130i is operated to extract the 
requested differential bit stream from the i-th separating storage means 120i in response 
to the request signal. 

The i-th second transmission means 143i is operated to transmit the requested 
30 differential bit stream extracted by the i-th separating bit stream extracting means 130i 
to the i-th bit stream merging unit 8200i. 

In the i-th bit stream merging unit 8200i, the i-th second receiving means 212i 
is operated to receive the requested differential bit stream transmitted by the i-th second 
transmission means 143i from the i-th bit stream separating unit 8100i. 
35 The i-th merging bit stream extracting means 24 li is operated to extract the i-th 

transcoded MPEG-2 bit stream 72.i from the i-th merging storage means 220i. 
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The i-th merging means 242i is operated to merge the i-th transcoded MPEG-2 
bit stream 72.i extracted by the i-th merging bit stream extracting means 241i with the 
requested differential bit stream received by the i-th second receiving means 212i to 
reconstruct the (i-l)-th transcoded MPEG-2 bit stream to be outputted to the outputting 
means OUTli. 

The outputting means OUTi is operated to input the the (i-l)-th transcoded 
MPEG-2 bit stream thus reconstructed to an (i-l)-th bit stream merging apparatus 
8200M. 

As will be seen from the foregoing description, the bit stream separating and 
merging system 8000 thus constructed makes it possible for a user to receive one or 
more transcoded MPEG-2 bit streams at bit rates much lower than that of the original 
MPEG-2 bit stream to decode, reproduce, and preview low-quality picture information, 
and later receive a plurality of differential bit streams at bit rates much lower than that 
of the original MPEG-2 bit stream to reproduce high-quality picture information in 
combining with the transcoded MPEG-2 bit streams earlier received thereby effectively 
utilize the transcoded MPEG-2 bit streams and the transmitting paths. 

According to the present invention, the bit stream separating and merging 
system may comprise multi-output bit stream separating apparatus including one or 
more of bit stream separating units same in construction as any one or more of the first 
to the sixth embodiment of bit stream separating apparatuses 1100, 2100, 3100, 4100, 
5100, and 6100 and the multi-input bit stream merging apparatus including one or more 
of bit stream merging units which are the same in construction as any one or more of the 
first to the sixth embodiment of bit stream merging apparatus 1200, 1200, 2200, 3200, 
4200, 5200, and 6200. 

The many features and advantages of the invention are apparent from the 
detailed specification, and thus it is intended by the appended claims to cover all such 
features and advantages of the invention which fall within the true spirit and scope 
thereof. Further, since numerous modifications and changes will readily occur to those 
skilled in the art, it is not desired to limit the invention to the exact construction and 
operation illustrated and described herein, and accordingly, all suitable modifications 
and equivalents may be construed as being encompassed within the scope of the 
invention. 
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